Apache Kyuubi(Incubating) 1.3.0-incubating 发布记录

要下载 Apache Kyuubi (Incubating) 1.3.0-incubating，请访问 下载页面。

重大更新

• 完全验证，支持最新的 Spark 3.0/3.1

• 支持在 JDK8（默认）、JDK11 上构建

• 在 Kyuubi Spark Extensions 中提供增强的 AQE（适用于 Spark 3.1）

• 提供几个辅助 SQL 函数作为 Spark 内置函数的补充

• Spark on Kubernetes 的主要改进，包括文档、集成测试、工具等

• 支持引擎/会话级别可配置的初始化 SQL 语句

• 支持自定义认证实现

• 支持通过 Web UI 停止 Spark 引擎

• 支持单会话模式

• 可观察性的几项改进

• 对数据湖平台 Delta、Iceberg 进行全面测试

• 对 MiniYARNCluster 进行全面测试

功能性

• [KYUUBI #631] Add kyuubi-spark-extensions-3-1 module

• [KYUUBI #657][KYUUBI #659] Provides auxiliary SQL functions as supplement to Spark’s built-in Functions

• [KYUUBI #897] Support stop Spark engine through Web UI

• [KYUUBI #762] Add Kyuubi Hive JDBC Module

• [KYUUBI #926] Support add repartition for OptimizedCreateHiveTableAsSelectCommand

• [KYUUBI #670] KyuubiSQLException support sqlState and errorCode

• [KYUUBI #707] Respect spark.sql.catalogImplementation in engine

• [KYUUBI #641] Support custom authentication

• [KYUUBI #751] Support single session mode

• [1.2][KYUUBI #457] Support configurable initialize sql statement for engine startup

• [KYUUBI #857] Support configurable initialize SQL statement for each session

集成

• [KYUUBI #755] Default build against Spark 3.1

• [KYUUBI #693][KYUUBI #760] Support build against JDK11

• [KYUUBI #768][K8S] Add module shuffle-files-cleaner

• [KYUUBI #844][K8S] Exposing Kyuubi as a NodePort service

• [KYUUBI #859][K8S] Add kubernetes configmap

• [KYUUBI #656][K8S] Document how to deploy Kyuubi engines on Kubernetes

• [KYUUBI #776][K8S] Run kyuubi on Kubernetes - make basic dockerfile and example

• [KYUUBI #444][KYUUBI #854][TEST][K8S] Add minikube for K8s integration test

• [KYUUBI #712][LDAP] Add a new config property authentication.ldap.guidKey

• [KYUUBI #643][TEST] Test Detla 1.0.0 with Spark 3.1

• [KYUUBI #948][TEST] Test Iceberg 0.12.0 with Spark 3.0/3.1

• [KYUUBI #527][TEST][YARN] Test with MiniYARNCluster

可观察性

• [KYUUBI #737] Add monitor module

• [KYUUBI #727] Add the listener for each SQL

• [KYUUBI #767] Add statement event tracking

性能

• [1.2][KYUUBI #629] Refine distributed lock to lock only engine bootstrap

其他

• [KYUUBI #416] Detected Dependency List Change for better dependency management

• [KYUUBI #487][KYUUBI #566] Add TPC-DS DDL test cases

• [KYUUBI #871] Change module name kyuubi-main to kyuubi-server