Releases Archive
[KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
[KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
[KYUUBI #1473] Exit gracefully when engine idle
[KYUUBI #1567] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
[KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl
[KYUUBI #1806] Fix LaunchEngine may be closed multiple times
[KYUUBI #1731] Kyuubi server should not fail to start when Hadoop FileSystem class not found
[KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
[KYUUBI #1800] [1.4] Remove oom hook
[KYUUBI #1784] Fix float types lose precision
[KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
[KYUUBI #1722] [NOTICE] Update NOTICE for 2022
[KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
[KYUUBI #1225] [KYUUBI #1228] Add kyuubi-extension-spark-3-2 module and profile to support latest spark-3.2
[KYUUBI #939] Add Z-Order extensions to support optimize SQL
[KYUUBI #913] Support long running SQL engine without principal and keytab provided
[KYUUBI #1219] Support MySQL Protocol Frontend
[KYUUBI #1349] Add new conf kyuubi.frontend.protocols
[KYUUBI #1206] Support GROUP engine share level
[KYUUBI #1018] Set spark.sql.execution.topKSortFallbackThreshold to 10000
[KYUUBI #1059] Add Plan Only Operations
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #1159] Add Session stats on Kyuubi Query Engine Page
[KYUUBI #1198] Support to incremental collect statement result
[KYUUBI #1248] Change kyuubi.engine.session.initialize.sql default value to Nil
[KYUUBI #1286] Increase kyuubi.session.engine.initialize.timeout default to 3min
[KYUUBI #1323] Introduce EngineType to distinguish multiple engines
[KYUUBI #1262] Support both KERBEROS and PLAIN authentication at the same time
[KYUUBI #1160] Support to config operation log root dir both for kyuubi server and engine sides
[KYUUBI #1204] Enhance zookeeper authentication and ACLs
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #703] Integrate test with Hudi 0.9.0
[KYUUBI #1338] Integrate test with Iceberg 0.12.1
[KYUUBI #1131] Rename KyuubiDriver to KyuubiHiveDriver
[KYUUBI #1346] Support launch query engine asynchronously during opening session
[KYUUBI #1377] Support to get launch engine log asynchronously with KyuubiConnection
[KYUUBI #1414] Add kyuubi-hive-beeline module to support KyuubiConnection and KyuubiStatement
[KYUUBI #1047] Use deployment to run kyuubi server HA on K8s
[KYUUBI #1223] Remove dead module kyuubi-spark-monitor
[KYUUBI #1277] Add UDF engine_id
[KYUUBI #660] Add UDF session_user
[KYUUBI #1190] Enhance error log detection in case lost the exception log
[KYUUBI #1067] Catch exception if logRoot is not exist
[KYUUBI #884] [FOLLOWUP] Fix catalog in KyuubiDatabaseMetaData#getTables
[KYUUBI #1108] Register KyuubiDriver in ServiceLoader
[KYUUBI #1094] [BUGFIX #1068]Support upload file to HDFS
[KYUUBI #1034] Engine may deadlock when close operationLog
[KYUUBI #1057] [KYUUBI#1056] Output error log when currentEngine is None
[KYUUBI #1158] [INFRA] Update ANNOUNCE mail template
[KYUUBI #1107] [INFRA] Add release mail templates
[KYUUBI #1141] Remove redundant unit
[KYUUBI #1134] [TEST] DataLake suites should clean up withKyuubiConf instead of extraConfigs
[KYUUBI #1130] [DOCS] Restore Kyuubi logo image size
[KYUUBI #1125] [FOLLOWUP] Compress and remove duplicated new logo and keep legacy logo
[KYUUBI #1125] A new version of logo flie, apache information included.
[KYUUBI #1104] Fix release script finalize_svn
[KYUUBI #1096] Remove never expired declaration in NOTICE
[KYUUBI #1263] Kyuubi auxiliary UDF failed on Spark Yarn mode
[KYUUBI #1267] Modify comments for the golden file test suite and fix it
完全验证,支持最新的 Spark 3.0/3.1
支持在 JDK8(默认)、JDK11 上构建
在 Kyuubi Spark Extensions 中提供增强的 AQE(适用于 Spark 3.1)
提供几个辅助 SQL 函数作为 Spark 内置函数的补充
Spark on Kubernetes 的主要改进,包括文档、集成测试、工具等
支持引擎/会话级别可配置的初始化 SQL 语句
支持自定义认证实现
支持通过 Web UI 停止 Spark 引擎
支持单会话模式
可观察性的几项改进
对数据湖平台 Delta、Iceberg 进行全面测试
对 MiniYARNCluster 进行全面测试
[KYUUBI #631] Add kyuubi-spark-extensions-3-1 module
[KYUUBI #657][KYUUBI #659] Provides auxiliary SQL functions as supplement to Spark’s built-in Functions
[KYUUBI #897] Support stop Spark engine through Web UI
[KYUUBI #762] Add Kyuubi Hive JDBC Module
[KYUUBI #926] Support add repartition for OptimizedCreateHiveTableAsSelectCommand
[KYUUBI #670] KyuubiSQLException support sqlState and errorCode
[KYUUBI #707] Respect spark.sql.catalogImplementation in engine
[KYUUBI #641] Support custom authentication
[KYUUBI #751] Support single session mode
[1.2][KYUUBI #457] Support configurable initialize sql statement for engine startup
[KYUUBI #857] Support configurable initialize SQL statement for each session
[KYUUBI #755] Default build against Spark 3.1
[KYUUBI #693][KYUUBI #760] Support build against JDK11
[KYUUBI #768][K8S] Add module shuffle-files-cleaner
[KYUUBI #844][K8S] Exposing Kyuubi as a NodePort service
[KYUUBI #859][K8S] Add kubernetes configmap
[KYUUBI #656][K8S] Document how to deploy Kyuubi engines on Kubernetes
[KYUUBI #776][K8S] Run kyuubi on Kubernetes - make basic dockerfile and example
[KYUUBI #444][KYUUBI #854][TEST][K8S] Add minikube for K8s integration test
[KYUUBI #712][LDAP] Add a new config property authentication.ldap.guidKey
[KYUUBI #643][TEST] Test Detla 1.0.0 with Spark 3.1
[KYUUBI #948][TEST] Test Iceberg 0.12.0 with Spark 3.0/3.1
[KYUUBI #527][TEST][YARN] Test with MiniYARNCluster
[KYUUBI #737] Add monitor module
[KYUUBI #727] Add the listener for each SQL
[KYUUBI #767] Add statement event tracking
- [1.2][KYUUBI #629] Refine distributed lock to lock only engine bootstrap
[KYUUBI #416] Detected Dependency List Change for better dependency management
[KYUUBI #487][KYUUBI #566] Add TPC-DS DDL test cases
[KYUUBI #871] Change module name kyuubi-main to kyuubi-server
Apache Kyuubi(Incubating) 1.4.1-incubating 发布记录
2022 1月 31
大家好,
Apache Kyuubi (Incubating) 1.4.1-incubating 现已发布。它是一个维护版本,包含基于 branch-1.4 的稳定性修复。主要修复事件日志的一些问题。
Apache Kyuubi (Incubating) 是一个用于大规模数据处理和分析的分布式多租户 JDBC 服务,构建在 Apache Spark 之上,旨在支持更多引擎(如 Apache Flink)。请参考 Apache Kyuubi (Incubating) 了解更多。
要下载 Apache Kyuubi (Incubating) 1.4.1-incubating,请访问 downloads page.
重大更新
其他
致谢
感谢以下贡献者帮助审查并提交代码至 Apache Kyuubi (Incubating) 1.4.1-incubating 版本,排序以字典顺序为准:
Cheng Pan, Fei Wang, Fu Chen, Muru Muthusamy, Wang Zhen, sunfangbin, sychen, ulysses-you, yanghua, zhenjiaguo, zhouyifan279, zwangsheng
Apache Kyuubi(Incubating) 1.4.0-incubating 发布记录
2021 12月 10
大家好,
在这个版本中,Kyuubi 支持最新的 Spark 3.2,Z-Order 优化 sql 查询,无需提供 principal 和 keytab 的长时间运行的 SQL 引擎,支持 mysql 协议前端和 mysql 客户端。 其他主要更新包括 GROUP 引擎共享级别的支持、支持异步打开会话、用户友好的 kyuubi beeline 和 zookeeper 身份验证增强。
要下载 Apache Kyuubi (Incubating) 1.4.0-incubating,请访问 下载页面。
重大更新
使用最新的 Spark 3.2 进行了全面验证
支持Z-Order优化SQL
支持长时间运行的 SQL 引擎,无需提供 principal 和 keytab
支持 GROUP 引擎共享级别
增强 USER 引擎共享级别,支持引擎池
增强 zookeeper 身份验证和 ACL
添加更多 Kyuubi 自定义的函数
对所有数据湖平台 Delta Lake、Iceberg 和 Hudi 进行全面测试
同时支持 KERBEROS 和 PLAIN 认证
支持 MySQL 协议前端和 MySQL 客户端(实验性质)
支持在打开会话期间异步启动查询引擎和用户友好的 Kyuubi Hive JDBC 和 BeeLine
功能性更新
集成
Hive JDBC
其他
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的: AnybodyHome, Brian Yue, Cheng Pan, Fei Wang, Fu Chen, Jagadesh Adireddi, Kent Yao, Min Zhao, Guoqing Yang, h, happytofly, hongdongdong, jiaoqingbo, qiuliang, qphien, senmiaoliu, simon, sunfangbin, sychen, timothy65535, ulysses-you, wFoget, xiebo03, xiongyinke, yanghua, yanyu34946, zhang1002, zhenjiaguo, zhouyifan279, zwangsheng, 张宇翔
Apache Kyuubi(Incubating) 1.3.1-incubating 发布记录
2021 10月 25
大家好,
Apache Kyuubi (Incubating) 1.3.1-incubating 现已发布。这是一个包含基于 branch-1.3 的稳定性修复的维护版本。主要修复事件日志的一些问题。
Apache Kyuubi (Incubating) 是一个用于大规模数据处理和分析的分布式多租户 JDBC 服务,构建在 Apache Spark 之上,旨在支持更多引擎(如 Apache Flink)。请参考 Apache Kyuubi (Incubating) 了解更多。
要下载 Apache Kyuubi (Incubating) 1.3.1-incubating,请访问 下载页面。
重大更新
其他
已知问题
致谢
感谢以下贡献者帮助审查并提交代码至 Apache Kyuubi (Incubating) 1.3.1-incubating 版本,以提交时间排序: qiuliang, hongdd, Yuxiang Zhang, Cheng Pan, happytofly, timothy, cxzl25, Xiduo You, Simon
Apache Kyuubi(Incubating) 1.3.0-incubating 发布记录
2021 9月 14
要下载 Apache Kyuubi (Incubating) 1.3.0-incubating,请访问 下载页面。