Releases Archive
[KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
[KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
[KYUUBI #1473] Exit gracefully when engine idle
[KYUUBI #1567] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
[KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl
[KYUUBI #1806] Fix LaunchEngine may be closed multiple times
[KYUUBI #1731] Kyuubi server should not fail to start when Hadoop FileSystem class not found
[KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
[KYUUBI #1800] [1.4] Remove oom hook
[KYUUBI #1784] Fix float types lose precision
[KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
[KYUUBI #1722] [NOTICE] Update NOTICE for 2022
[KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
[KYUUBI #1225] [KYUUBI #1228] Add kyuubi-extension-spark-3-2 module and profile to support latest spark-3.2
[KYUUBI #939] Add Z-Order extensions to support optimize SQL
[KYUUBI #913] Support long running SQL engine without principal and keytab provided
[KYUUBI #1219] Support MySQL Protocol Frontend
[KYUUBI #1349] Add new conf kyuubi.frontend.protocols
[KYUUBI #1206] Support GROUP engine share level
[KYUUBI #1018] Set spark.sql.execution.topKSortFallbackThreshold to 10000
[KYUUBI #1059] Add Plan Only Operations
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #1159] Add Session stats on Kyuubi Query Engine Page
[KYUUBI #1198] Support to incremental collect statement result
[KYUUBI #1248] Change kyuubi.engine.session.initialize.sql default value to Nil
[KYUUBI #1286] Increase kyuubi.session.engine.initialize.timeout default to 3min
[KYUUBI #1323] Introduce EngineType to distinguish multiple engines
[KYUUBI #1262] Support both KERBEROS and PLAIN authentication at the same time
[KYUUBI #1160] Support to config operation log root dir both for kyuubi server and engine sides
[KYUUBI #1204] Enhance zookeeper authentication and ACLs
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #703] Integrate test with Hudi 0.9.0
[KYUUBI #1338] Integrate test with Iceberg 0.12.1
[KYUUBI #1131] Rename KyuubiDriver to KyuubiHiveDriver
[KYUUBI #1346] Support launch query engine asynchronously during opening session
[KYUUBI #1377] Support to get launch engine log asynchronously with KyuubiConnection
[KYUUBI #1414] Add kyuubi-hive-beeline module to support KyuubiConnection and KyuubiStatement
[KYUUBI #1047] Use deployment to run kyuubi server HA on K8s
[KYUUBI #1223] Remove dead module kyuubi-spark-monitor
[KYUUBI #1277] Add UDF engine_id
[KYUUBI #660] Add UDF session_user
[KYUUBI #1190] Enhance error log detection in case lost the exception log
[KYUUBI #1067] Catch exception if logRoot is not exist
[KYUUBI #884] [FOLLOWUP] Fix catalog in KyuubiDatabaseMetaData#getTables
[KYUUBI #1108] Register KyuubiDriver in ServiceLoader
[KYUUBI #1094] [BUGFIX #1068]Support upload file to HDFS
[KYUUBI #1034] Engine may deadlock when close operationLog
[KYUUBI #1057] [KYUUBI#1056] Output error log when currentEngine is None
[KYUUBI #1158] [INFRA] Update ANNOUNCE mail template
[KYUUBI #1107] [INFRA] Add release mail templates
[KYUUBI #1141] Remove redundant unit
[KYUUBI #1134] [TEST] DataLake suites should clean up withKyuubiConf instead of extraConfigs
[KYUUBI #1130] [DOCS] Restore Kyuubi logo image size
[KYUUBI #1125] [FOLLOWUP] Compress and remove duplicated new logo and keep legacy logo
[KYUUBI #1125] A new version of logo flie, apache information included.
[KYUUBI #1104] Fix release script finalize_svn
[KYUUBI #1096] Remove never expired declaration in NOTICE
[KYUUBI #1263] Kyuubi auxiliary UDF failed on Spark Yarn mode
[KYUUBI #1267] Modify comments for the golden file test suite and fix it
Fully verified with the latest Spark 3.0/3.1
Support build on JDK8(default), JDK11
Provide enhanced AQE in Kyuubi Spark Extensions (for Spark 3.1)
Provide several auxiliary SQL functions as a supplement to Spark’s built-in Functions
Major improvements of Spark on Kubernetes, include documents, integration tests, tools, etc.
Support engine/session level configurable initialize SQL statements
Support custom authentication implementation
Support stop Spark engine through Web UI
Support single session mode
Several improvements of observability
Fully tested with the all data lake platforms Delta, Iceberg
Fully tested with MiniYARNCluster
[KYUUBI #631] Add kyuubi-spark-extensions-3-1 module
[KYUUBI #657][KYUUBI #659] Provides auxiliary SQL functions as supplement to Spark’s built-in Functions
[KYUUBI #897] Support stop Spark engine through Web UI
[KYUUBI #762] Add Kyuubi Hive JDBC Module
[KYUUBI #926] Support add repartition for OptimizedCreateHiveTableAsSelectCommand
[KYUUBI #670] KyuubiSQLException support sqlState and errorCode
[KYUUBI #707] Respect spark.sql.catalogImplementation in engine
[KYUUBI #641] Support custom authentication
[KYUUBI #751] Support single session mode
[1.2][KYUUBI #457] Support configurable initialize sql statement for engine startup
[KYUUBI #857] Support configurable initialize SQL statement for each session
[KYUUBI #755] Default build against Spark 3.1
[KYUUBI #693][KYUUBI #760] Support build against JDK11
[KYUUBI #768][K8S] Add module shuffle-files-cleaner
[KYUUBI #844][K8S] Exposing Kyuubi as a NodePort service
[KYUUBI #859][K8S] Add kubernetes configmap
[KYUUBI #656][K8S] Document how to deploy Kyuubi engines on Kubernetes
[KYUUBI #776][K8S] Run kyuubi on Kubernetes - make basic dockerfile and example
[KYUUBI #444][KYUUBI #854][TEST][K8S] Add minikube for K8s integration test
[KYUUBI #712][LDAP] Add a new config property authentication.ldap.guidKey
[KYUUBI #643][TEST] Test Detla 1.0.0 with Spark 3.1
[KYUUBI #948][TEST] Test Iceberg 0.12.0 with Spark 3.0/3.1
[KYUUBI #527][TEST][YARN] Test with MiniYARNCluster
[KYUUBI #737] Add monitor module
[KYUUBI #727] Add the listener for each SQL
[KYUUBI #767] Add statement event tracking
- [1.2][KYUUBI #629] Refine distributed lock to lock only engine bootstrap
[KYUUBI #416] Detected Dependency List Change for better dependency management
[KYUUBI #487][KYUUBI #566] Add TPC-DS DDL test cases
[KYUUBI #871] Change module name kyuubi-main to kyuubi-server
Apache Kyuubi(Incubating) 1.4.1-incubating Release Notes
2022 Jan 31
Hi all,
Apache Kyuubi (Incubating) 1.4.1-incubating is now released. It is a maintenance release containing stability fixes which is based on branch-1.4. Mainly fix some issues of the event log.
Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark and designed to support more engines (i.e. Apache Flink). Please refer to Apache Kyuubi (Incubating) to learn more.
To download Apache Kyuubi (Incubating) 1.4.1-incubating, visit the downloads page.
Highlight
Others
Credits
Thank you for the following contributors who helped to review and commit to Apache Kyuubi (Incubating) 1.4.1-incubating version, and the order is based on the lexicographical order:
Cheng Pan, Fei Wang, Fu Chen, Muru Muthusamy, Wang Zhen, sunfangbin, sychen, ulysses-you, yanghua, zhenjiaguo, zhouyifan279, zwangsheng
Apache Kyuubi(Incubating) 1.4.0-incubating Release Notes
2021 Dec 10
Hi all,
In this release, Kyuubi supports the latest Spark 3.2, Z-Order to optimize sql, long running SQL engine without principal and keytab provided, mysql protocol frontend and mysql client. Other major updates includes GROUP engine.share.level support, asynchronous opening session, user-friendly kyuubi beeline and zookeeper authentication enhancement.
To download Apache Kyuubi (Incubating) 1.4.0-incubating, visit the downloads page.
Highlight
Fully verified with the latest Spark 3.2
Support Z-Order to optimize SQL
Support long running SQL engine without principal and keytab provided
Support GROUP engine share level
Enhance USER engine share level support engine pool
Enhance zookeeper authentication and ACLs
Add more Kyuubi defined functions
Fully tested with all data lake platform Delta Lake, Iceberg and Hudi
Support both KERBEROS and PLAIN authentication at the same time
Support MySQL protocol frontend and MySQL client(experimental)
Support to launch query engine asynchronously during opening session and user-friendly Kyuubi Hive JDBC and BeeLine
Functionality
Integration
Hive JDBC
Others
Credits
Last but not least, this release would not have been possible without the following contributors: AnybodyHome, Brian Yue, Cheng Pan, Fei Wang, Fu Chen, Jagadesh Adireddi, Kent Yao, Min Zhao, Guoqing Yang, h, happytofly, hongdongdong, jiaoqingbo, qiuliang, qphien, senmiaoliu, simon, sunfangbin, sychen, timothy65535, ulysses-you, wFoget, xiebo03, xiongyinke, yanghua, yanyu34946, zhang1002, zhenjiaguo, zhouyifan279, zwangsheng, 张宇翔
Apache Kyuubi(Incubating) 1.3.1-incubating Release Notes
2021 Oct 25
Hi all,
Apache Kyuubi (Incubating) 1.3.1-incubating is now released. It is a maintenance release containing stability fixes which is based on branch-1.3. Mainly fix some issues of the event log.
Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark and designed to support more engines (i.e. Apache Flink). Please refer to Apache Kyuubi (Incubating) to learn more.
To download Apache Kyuubi (Incubating) 1.3.1-incubating, visit the downloads page.
Highlight
Others
Knwon Issues
Credits
Thank you for the following contributors who helped to review and commit to Apache Kyuubi (Incubating) 1.3.1-incubating version, and the order is based on the commit time:
qiuliang, hongdd, Yuxiang Zhang, Cheng Pan, happytofly, timothy, cxzl25, Xiduo You, Simon
Apache Kyuubi(Incubating) 1.3.0-incubating Release Notes
2021 Sep 14
To download Apache Kyuubi (Incubating) 1.3.0-incubating, visit the downloads page.