Releases Archive
- 支持批(Jar)任务提交
- 支持 Thrift HTTP 模式
- 支持 Etcd 作为发现服务
- 支持 JDBC 认证机制
- 统一 Thrift 和 REST v1 API 的认证
- 增强指标系统
- 新增批(Jar)任务提交的 REST 客户端
- 内置 JDBC 驱动程序剥离 Hive 和 Hadoop 依赖
- 内置 JDBC 驱动程序支持使用 keytab 进行 Kerberos 身份验证
- 增强 beeline 以支持 Spark 控制台进度条
- 使用最新 Spark 3.1/3.2/3.3 充分验证
- 使用最新 Flink 1.14/1.15 充分验证
- 使用 Trino 363 全面验证
- 支持 Hive 后端引擎 (Beta)
- 支持 JDBC 后端引擎 (Beta)
- 新增 Spark TPC-DS 连接器
- 新增 Spark TPC-H 连接器
- 新增 Spark Authz (Apache Ranger) 插件
- 用户文档重构和完善
- [KYUUBI #3363] Kyuubi Beeline requires commons-lang
- [KYUUBI #3353] Backport HIVE-21899 - Utils.getCanonicalHostName() may return IP address depending on DNS infra
- [KYUUBI #3355] Backport HIVE-20583 - Use canonical hostname only for kerberos auth in HiveConnection
- [KYUUBI #3348] Specifies none checks to be performed on Javadoc comments for maven-javadoc-plugin
- [KYUUBI #3347] [MINOR] Relocation
AccessControlException
- [KYUUBI #3336] Use StageAttempt instead of StageId in SQLOperationListener
- [KYUUBI #3023] [FOLLOWUP] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
- [KYUUBI #3316] [BUILD] Enable spark-3.3 profile for license check on GA
- [KYUUBI #3254] Supplement the licenses of support etcd discovery
- [KYUUBI #3301] Construct lifetimeTerminatingChecker only when needed
- [KYUUBI #3272] Synchronize graceful shutdown with main stop sequence
- [KYUUBI #3281] [MINOR] Use AccessControlException instead of RuntimeException if check privilege failed
- [KYUUBI #3222] [FOLLOWUP] Fixing placeholder and config of user in JDBC Authentication Provider
- [KYUUBI #3275] [KYUUBI 3269] [DOCS] Doc for JDBC authentication provider
- [KYUUBI #3217] [DOCS] Doc for using Marcos in row-level filter in Authz
- [KYUUBI #3297] [MINOR] Null is replaced by KyuubiSQLException.featureNotSupported()
- [KYUUBI #3244] Bump Hudi 0.12.0
- [KYUUBI #3287] Exclude reload4j from hadoop-minikdc
- [KYUUBI #3222] [FOLLOWUP] Introdude JdbcUtils to simplify code
- [KYUUBI #3020] [FOLLOWUP] Refactor the code style
- [KYUUBI #3020] kyuubi ldap add new config property kyuubi.authentication.ldap.bindpw and kyuubi.authentication.ldap.attrs
- [KYUUBI #3226] Privileges should be checked only once in
RuleAuthorization
- [KYUUBI #3156] Expose REST frontend connection metrics
- [KYUUBI #3241] [DOCS] Update
Develop Tools / Building a Runnable Distribution
- [KYUUBI #3255] Add miss engine type config docs
- [KYUUBI #3214] Plan only mode should unset when mode value is incorrect
- [KYUUBI #3239] [SUBTASK] DorisSQLEngine - Add integration tests
- [KYUUBI #3252] Fix the problem that |release| in the document was not replaced correctly
- [KYUUBI #3247] Minor clean up Kyuubi JDBC code
- [KYUUBI #3222] JDBC Authentication Provider for server
- [KYUUBI #3243] Move trait Logging#initializeLogging to object Logging
- [KYUUBI #3245] Add spark-3.3 profile in building.md
- [KYUUBI #3184] OperationResource rowset api should have default values for maxrows and fetchorientation
- [KYUUBI #3220] Make kyuubi.engine.ui.stop.enabled false in HistoryServer
- [KYUUBI #1776] [FOLLOWUP] Fill empty td tag for
Failure Reason
column in EngineTable - [KYUUBI #3157] [DOC] Modify logging doc due to using log4j2 instead of log4j
- [KYUUBI #3228] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-DS
- [KYUUBI #3138] [SUBTASK] DorisSQLEngine - Add jdbc engine to dist
- [KYUUBI #3230] Flink SQL engine supports run across versions
- [KYUUBI #3072] [DOC] Add a doc of Flink Table Store for Flink SQL engine
- [KYUUBI #3170] Expose thrift binary connection metrics
- [KYUUBI #3227] SparkConfParser supports parse bytes and time
- [KYUUBI #3219] Error renew delegation tokens: Unknown version of delegation token 8
- [KYUUBI #3080] [DOC] Add a doc of the Flink Table Store for the Trino SQL Engine
- [KYUUBI #3107] [SUBTASK] DorisSQLEngine - Add process builder (#3123)
- [KYUUBI #3211] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-H
- [KYUUBI #3206] Change Flink default version to 1.15
- [KYUUBI #833] Check if
spark.kubernetes.executor.podNamePrefix
is invalid - [KYUUBI #3098] Unify the event log code path
- [KYUUBI #3210] [DOCS] Mention Kyuubi Spark SQL extension supports Spark 3.3
- [KYUUBI #3204] Fix duplicated ldapServer#close in LdapAuthenticationProviderImplSuite
- [KYUUBI #3209] Support configure TPC-H connector in runtime
- [KYUUBI #3200] Make KyuubiSessionEvent.sessionId clear
- [KYUUBI #3186] Support applying Row-level Filter and Data Masking policies for DatasourceV2 in Authz module
- [KYUUBI #2584] [INFRA] Migrate CI to Ubuntu 22.04
- [KYUUBI #3172] [FLINK] Fix failed test cases in Flink 1.15
- [KYUUBI #3203] [DOCS] Fix typo
- [KYUUBI #3192] Refactor TPCDSConf
- [KYUUBI #3180] Add component version util
- [KYUUBI #3162] Bump Hadoop 3.3.4
- [KYUUBI #3191] [DOCS] Add missing binary scala version in engine jar name
- [KYUUBI #3199] [BUILD] Fix travis JAVA_HOME
- [KYUUBI #3194] [Scala-2.13] Refine deprecated config
- [KYUUBI #3198] [DOCS] Fix index of Hudi Flink connector
- [KYUUBI #3189] [BUILD] Bump jetcd 0.7.3 and pin Netty dependencies
- [KYUUBI #3190] [BUILD] Use jdk_switcher to setup JAVA_HOME
- [KYUUBI #3145] Bump log4j from 2.17.2 to 2.18.0
- [KYUUBI #3135] Bump gRPC from 1.47.0 to 1.48.0
- [KYUUBI #3178] Add application operation docs
- [KYUUBI #3174] Update MATURITY for C30, RE50, CO20, CO40, CO50, CS10, IN10
- [KYUUBI #3175] Add session conf advisor docs
- [KYUUBI #3141] Trino engine etcd support
- [KYUUBI #3150] Expose metadata request metrics
- [KYUUBI #3070] [DOC] Add a doc of the Hudi connector for the Flink SQL Engine
- [KYUUBI #3104] Support SSL for Etcd
- [KYUUBI #3152] Introduce JDBC parameters to control connection timeout
- [KYUUBI #3136] Change Map to a case class ApplicationInfo as the application info holder
- [KYUUBI #2240] [SUBTASK] Skip add metadata manager if frontend does not support rest
- [KYUUBI #3131] Improve operation state change logging
- [KYUUBI #3158] Fix npe issue when formatting the kyuubi-ctl output
- [KYUUBI #3160] [DOCS]
Dependencies
links inConnectors for Spark SQL Query Engine
pages jump to wrong place #3160 (#3161) - [KYUUBI #3154] [SUBTASK] Connectors for Spark SQL Query Engine -> TiDB/TiKV
- [KYUUBI #3082] Add iceberg connector doc for Trino SQL Engine
- [KYUUBI #3071] [DOC] Add iceberg connector for Flink SQL Engine
- [KYUUBI #3153] Move batch util class to kyuubi rest sdk for programing friendly
- [KYUUBI #3067] [DOC] Add Flink Table Store connector doc for Spark SQL Engine
- [KYUUBI #3148] Change etcd docker image to recover arm64 CI
- [KYUUBI #3119] [TEST] Using more light-weight SparkPi for batch related tests
- [KYUUBI #3023] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
- [KYUUBI #3144] Remove deprecated KyuubiDriver in services manifest
- [KYUUBI #3143] Check class loadable before applying SLF4JBridgeHandler
- [KYUUBI #3139] Override toString method for rest dto classes
- [KYUUBI #3087] Convert the kyuubi batch conf with
spark.
prefix so that spark could identify - [KYUUBI #3133] Always run Flink statement in sync mode
- [KYUUBI #3121] [CI] Fix GA oom issue
- [KYUUBI #3126] Using markdown 3.3.7 for kyuubi document build
- [KYUUBI #3106] Correct
RelMetadataProvider
used in flink-sql-engine - [KYUUBI #3069] [DOC] Add Iceberg connector doc for Spark SQL Engine
- [KYUUBI #3068] [DOC] Add the Hudi connector doc for Spark SQL Query Engine
- [KYUUBI #3108] [DOC] Fix path errors in the build document
- [KYUUBI #3111] Replace HashMap with singletonMap
- [KYUUBI #3113] Bump up delta lake version from 2.0.0rc1 to 2.0.0
- [KYUUBI #3101] [SUBTASK][#3100] Build the content for extension points documentation
- [KYUUBI #3102] Fix multi endpoints for etcd
- [KYUUBI #3008] Bump prometheus from 0.14.1 to 0.16.0
- [KYUUBI #3095] Move TPC-DS/TPC-H queries to unique folder
- [KYUUBI #3094] Code refactor on Kyuubi Hive JDBC driver
- [KYUUBI #3092] Replace apache commons Base64 w/ JDK
- [KYUUBI #3093] Fix Kyuubi Hive JDBC driver SPNEGO header
- [KYUUBI #3050] Bump Apache Iceberg 0.14.0
- [KYUUBI #3044] Bump Spark 3.2.2
- [KYUUBI #3052] [FOLLOWUP] Do not use the ip in proxy http header for authentication to prevent CVE
- [KYUUBI #3051] Support to get the real client ip address for thrift connection when using VIP as kyuubi server load balancer
- [KYUUBI #3046] [Metrics] Add meter metrics for recording the rate of the operation state for each kyuubi operation
- [KYUUBI #3045] [FOLLOWUP] Correct the common options and add docs for kyuubi-admin command
- [KYUUBI #3076] [SUBTASK][#3039] Add the docs for rest api - Batch Resource
- [KYUUBI #3077] Remove meaningless statement override in LaunchEngine
- [KYUUBI #3018] [SUBTASK] DorisSQLEngine - GetColumns Operation
- [KYUUBI #3073] CredentialsManager should use appUser to renew credential
- [KYUUBI #3065] Support to retry the killApplicationByTag for JpsApplicationOperation
- [KYUUBI #3054] Add description of the discovery client in the conf doc
- [KYUUBI #3043] [FOLLOWUP] Restore accidentally removed public APIs of kyuubi-hive-jdbc module
- [KYUUBI #3060] [SUBTASK][#3059] Build content of the connector document section
- [KYUUBI #3045] Support to do admin rest request with kyuubi-adminctl
- [KYUUBI #3055] Expose client ip address into batch request conf
- [KYUUBI #3052] Support to get the real client ip address for http connection when using VIP as kyuubi server load balancer
- [KYUUBI #3043] Clean up Kyuubi Hive JDBC client
- [KYUUBI #3047] Fallback krb5 conf to OS if not configured
- [KYUUBI #2644] Add etcd discovery client for HA
- [KYUUBI #3040] [SUBTASK][#3039] Build the skeleton of client side documentation
- [KYUUBI #2974] [FEATURE] EOL Support for Spark 3.0
- [KYUUBI #3042] Kyuubi Hive JDBC should throw KyuubiSQLException
- [KYUUBI #3037] Handles configuring the JUL -> SLF4J bridge
- [KYUUBI #3033] [Bug] Kyuubi failed to start due to PID directory not exists
- [KYUUBI #3028] [FLINK] Bump Flink versions to 1.14.5 and 1.15.1
- [KYUUBI #2478] [FOLLOWUP] Fix bin/beeline without -u exits unexpectedly
- [KYUUBI #3025] Fix the kyuubi restful href link format issue
- [KYUUBI #3007] Bump scopt from 4.0.1 to 4.1.0
- [KYUUBI #3019] Backport HIVE-21538 - Beeline: password source though the console reader did not pass to connection param
- [KYUUBI #3017] kyuubi-ctl should print error message to right place
- [KYUUBI #3010] Bump Jetty from 9.4.41.v20210516 to 9.4.48.v20220622
- [KYUUBI #3011] Bump swagger from 2.1.11 to 2.2.1
- [KYUUBI #3009] Bump Jersey from 2.35 to 2.36
- [KYUUBI #2801] [FOLLOWUP] Also check whether the batch main resource path is in local dir allow list
- [KYUUBI #3012] Remove unused thrift request max attempts and related ut
- [KYUUBI #3005] [DOCS] Correct spelling errors and optimizations in ‘Building Kyuubi Documentation’ part
- [KYUUBI #3004] Clean up JDBC shaded client pom and license
- [KYUUBI #2895] Show final info in trino engine
- [KYUUBI #2984] Refactor TPCDS configurations using SparkConfParser
- [KYUUBI #2996] Remove Hive storage-api dependencies from Kyuubi Hive JDBC
- [KYUUBI #2997] Use spark shim set current namespace
- [KYUUBI #2994] Remove Hive common dependencies from Kyuubi Hive JDBC
- [KYUUBI #2850] [FOLLOWUP] Replace log4j2.properties by log4j2.xml
- [KYUUBI #2801] Add local dir allow list and check the application access path URI
- [KYUUBI #2953] Support to interrupt the thrift request if remote engine is broken
- [KYUUBI #2999] Fix Kyuubi Hive Beeline dependencies
- [KYUUBI #2850] [FOLLOWUP] Fix default log4j2 configuration
- [KYUUBI #2977] [BATCH] Using KyuubiApplicationManger#tagApplication help tag batch application
- [KYUUBI #2993] Fix typo in KyuubiConf and mark more config entries server only
- [KYUUBI #2987] Remove Hive shims-common and shims-0.23 dependencies from Kyuubi Hive JDBC
- [KYUUBI #2985] Prompt configuration when starting engine timeout
- [KYUUBI #2989] Remove HS2 active-passive support in Kyuubi Hive JDBC client
- [KYUUBI #2983] Remove Hive llap-client dependencies from Kyuubi Hive JDBC
- [KYUUBI #2981] Improve TPC-DS scan performance
- [KYUUBI #2917] Remove Hive service dependencies from Kyuubi Hive JDBC
- [KYUUBI #2868] [K8S] Add KubernetesApplicationOperation
- [KYUUBI #2979] Fix helm icon url
- [KYUUBI #2978] [SUBTASK][KPIP-4] If batch app status not found from cluster manager, fall back to metadata store
- [KYUUBI #2975] Code improvement in rest client
- [KYUUBI #2964] [SUBTASK][KPIP-4] Refine the batch response and render
- [KYUUBI #2976] Expose session name into kyuubi engine tab
- [KYUUBI #2850] [FOLLOWUP] Provide log4j2.xml.template in binary and use log4j2-defaults.xml
- [KYUUBI #2963] Bump Delta 2.0.0rc1
- [KYUUBI #2918] [Bug] Kyuubi integrated Ranger failed to query: table stats must be specified
- [KYUUBI #2966] Remove TProtocolVersion from SessionHandle/OperationHandle
- [KYUUBI #2972] Using stdout for the output of kyuubi-ctl
- [KYUUBI #2973] Decorate LOG in the RetryableRestClient with static final
- [KYUUBI #2962] [SUBTASK][KPIP-4] Throw exception if the metadata update count is zero
- [KYUUBI #2956] Support to config the connect/socket timeout of rest client for kyuubi-ctl
- [KYUUBI #2960] TFrontendService.SERVER_VERSION shall be HIVE_CLI_SERVICE_PROTOCOL_V11
- [KYUUBI #2957] [SUBTASK][KPIP-4] Use canonical host name for kyuubi instance
- [KYUUBI #2952] Remove OperationType from OperationHandle for simplification
- [KYUUBI #2955] BatchRequest args fix: need toString operation for different data types
- [KYUUBI #2949] Flaky test: execute statement - analysis exception
- [KYUUBI #2951] No need to extend CompositeService for MetadataManager
- [KYUUBI #2948] Remove thrift request timeout for KyuubiSyncThriftClient
- [KYUUBI #2943] [Bug][K8S] Remove Start Local Kyuubi Server For Kyuubi On K8S Test
- [KYUUBI #2924] Correct the frontend server start state
- [KYUUBI #886] [FOLLOWUP] Support to reload hadoop conf for KyuubiTHttpFrontendService
- [KYUUBI #2929] Kyuubi integrated Ranger does not support the CTAS syntax
- [KYUUBI #2935] Support spnego authentication for thrift http transport mode
- [KYUUBI #2894] Add synchronized for the ciphers of internal security accessor
- [KYUUBI #2927] Fix the thread in ScheduleThreadExecutorPool can’t be shutdown immediately
- [KYUUBI #2876] Bump Hudi 0.11.1
- [KYUUBI #2922] Clean up SparkConsoleProgressBar when SQL execution fails
- [KYUUBI #2919] Fix typo and wording for JDBCMetadataStoreConf
- [KYUUBI #2920] Fix typo for mysql metadata schema
- [KYUUBI #2890] Get the db From Sparksession When TableIdentifier’s Database Field Is Empty
- [KYUUBI #2911] [SUBTASK][KPIP-4] If the kyuubi instance unreachable, support to backfill state from resource manager and mark batch closed by remote kyuubi instance
- [KYUUBI #2912] [INFRA][DOCS] Improve release md
- [KYUUBI #2905] [DOCS] Update the number of new committers in MATURITY.md
- [KYUUBI #2745] [SUBTASK] DorisSQLEngine - GetTables Operation
- [KYUUBI #2628] [FOLLOWUP] Support waitCompletion for submit batch
- [KYUUBI #2827] [BUILD][TEST] Decouple integration tests from kyuubi-server
- [KYUUBI #2898] Bump maven-surefire-plugin 3.0.0-M7
- [KYUUBI #2628] [FOLLOWUP] Reuse the kyuubi-ctl batch commands for SubmitBatchCommand
- [KYUUBI #2897] Remove Hive metastore dependencies from Kyuubi Hive JDBC
- [KYUUBI #2782] Decouple Kyuubi Hive JDBC from Hive Serde
- [KYUUBI #2854] Add exception field in KyuubiSessionEvent
- [KYUUBI #2873] [INFRA][DOCS] Improve release template script
- [KYUUBI #2761] Flaky Test: engine.jdbc.doris.StatementSuite - test select
- [KYUUBI #2834] [SUBTASK][KPIP-4] Support to retry the metadata requests on transient issue and unblock main thread
- [KYUUBI #2543] Add
maxPartitionBytes
configuration for TPC-DS connecter - [KYUUBI #886] Add HTTP transport mode support to KYUUBI - no Kerberos support
- [KYUUBI #2628] [FOLLOWUP] Refine kyuubi-ctl batch commands
- [KYUUBI #2859] [SUBTASK][KPIP-4] Support
--conf
for kyuubi-ctl - [KYUUBI #2888] Bump Spark-3.3.0
- [KYUUBI #2708] Open engine session and renew engine credentials in the one
- [KYUUBI #2668] [FOLLOWUP] Add log4j for rest client test
- [KYUUBI #2881] [SUBTASK][KPIP-4] Rest client supports retry request if catch net exception
- [KYUUBI #2883] [Bug] java.lang.NoClassDefFoundError: org/apache/hadoop/hive/common/ValidWriteIdList in HiveDelegationTokenProvider#initialize
- [KYUUBI #2813] Bump Iceberg 0.13.2
- [KYUUBI #2628] [SUBTASK][KPIP-4] Implement kyuubi-ctl for batch job operation
- [KYUUBI #2872] Catch the exception for the iterator job when incremental collect is enabled
- [KYUUBI #2870] Fix sf0 query error in TPCH
- [KYUUBI #2861] [FOLLOWUP][GA] Daily publish snapshot with profile spark-3.3
- [KYUUBI #2865] Bump Spark 3.3.0-rc6
- [KYUUBI #2863] Unify the logic of tpch and tpcds to generate golden file
- [KYUUBI #2862] [BUILD] Release script supports Spark 3.3
- [KYUUBI #2861] [GA] Daily publish snapshot with profile spark-3.3
- [KYUUBI #2624] Support isExtended for FilteredShowTablesCommand in AuthZ module.
- [KYUUBI #2858] Support skipTests for kyuubi rest client module
- [KYUUBI #2848] Global temp view should only exist in session catalog
- [KYUUBI #2849] Close the engine alive pool gracefully
- [KYUUBI #2851] Log session name when opening/closing session
- [KYUUBI #2247] Change log4j2 properties to xml
- [KYUUBI #2704] verify TPC-DS query output
- [KYUUBI #2846] Add v1.5.2-incubating changelog
- [KYUUBI #2842] [TEST] Optimize the output of ExceptionThrowingDelegationTokenProvider in the Test
- [KYUUBI #2829] Make secret id static and remove thrift protocol from RPC handles
- [KYUUBI #2820] [FOLLOWUP] Fix duplicate SPNEGO typo
- [KYUUBI #2839] Refactor changelog
- [KYUUBI #2781] Fix KyuubiDataSource#getConnection to set user and password
- [KYUUBI #2845] [GA] Stop daily publish on branch-1.3
- [KYUUBI #2805] Add TPC-H queries verification
- [KYUUBI #2837] [BUILD] Support publish to private repo
- [KYUUBI #2820] [SUBTASK][KPIP-4] Support to redirect getLocalLog and closeBatchSession requests across kyuubi instances
- [KYUUBI #2830] Imporve Z-Order with Spark3.3
- [KYUUBI #2746] [INFRA] Improve NOTICE of binary release
- [KYUUBI #2825] [BUILD] Remove kyuubi-flink-sql-engine from kyuubi-server dependencies
- [KYUUBI #2211] [IMPROVEMENT] Add CHANGELOG.md to codebase for maintaining release notes
- [KYUUBI #2643] [FOLLOWUP] Using javax AuthenticationException instead of hadoop AuthenticationException
- [KYUUBI #2373] [SUBTASK][KPIP-4] Support to recovery batch session on Kyuubi instances restart
- [KYUUBI #2824] [TEST] Replace test tag ExtendedSQLTest by Slow
- [KYUUBI #2822] [GA] Set log level to info
- [KYUUBI #2817] Bump Spark 3.3.0-rc5
- [KYUUBI #2676] Flaky Test: SparkOperationProgressSuite: test operation progress
- [KYUUBI #2812] [SUBTASK][KPIP-4] Refine the batch info response
- [KYUUBI #2469] Support RangerDefaultAuditHandler for AuthZ module
- [KYUUBI #2807] Trino, Hive and JDBC Engine support session conf in newExecuteStatementOperation
- [KYUUBI #2814] Set JAVA_HOME in travis via javac
- [KYUUBI #2804] Add flaky test report template
- [KYUUBI #2800] [FOLLOWUP] Return CloseBatchReponse for kyuubi rest client deleteBatch
- [KYUUBI #2800] Refine batch mode code path
- [KYUUBI #2802] Retry opening the TSocket in KyuubiSyncThriftClient
- [KYUUBI #2742] Introduce admin resource for service admin - refresh frontend hadoop conf without restart
- [KYUUBI #2794] Change KyuubiRestException to extend RuntimeException
- [KYUUBI #2793] [DOCS] Add debugging engine
- [KYUUBI #2788] Add excludeDatabases for TPC-H catalogs
- [KYUUBI #2780] Refine stylecheck
- [KYUUBI #2789] Kyuubi Spark TPC-H Connector - Add tiny scale
- [KYUUBI #2765] [SUBTASK][KPIP-4] Refactor current kyuubi-ctl
- [KYUUBI #2717] [FOLLOWUP] Fix BatchRestApiSuite due to jdbc state store UPPER the batch type
- [KYUUBI #2717] [SUBTASK][KPIP-4] Introduce jdbc session state store for batch session multiple HA
- [KYUUBI #2643] [FOLLOWUP] Generate spnego auth token dynamically per request
- [KYUUBI #2741] Add kyuubi-spark-connector-common module
- [KYUUBI #2775] Add excludeDatabases for TPC-DS catalogs
- [KYUUBI #2643] [FOLLOWUP] Refine the rest sdk
- [KYUUBI #2553] Kyuubi Spark TPC-DS Connector - Add tiny scale
- [KYUUBI #2772] Kyuubi Spark TPC-H Connector - use log4j1
- [KYUUBI #2643] [SUBTASK][KPIP-4] Implement kyuubi rest sdk for batch job operation
- [KYUUBI #2763] Expected error code for invalid basic/spnego authentication should be SC_FORBIDDEN
- [KYUUBI #2768] Use the default DB passed in by session in Flink
- [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar
- [KYUUBI #2760] Add adapter layer in Kyuubi Hive JDBC module
- [KYUUBI #2751] [DOC] Replace sphinx_rtd_theme with sphinx_book_theme
- [KYUUBI #2754] [GA] Separate log archive name
- [KYUUBI #2755] [SUBTASK] DorisSQLEngine - add jdbc label
- [KYUUBI #2752] Kyuubi Spark TPC-DS Connector - configurable catalog’s name by initialize method
- [KYUUBI #2721] Implement dedicated set/get catalog/database operators
- [KYUUBI #2664] Kyuubi Spark TPC-H Connector - SupportsReportStatistics
- [KYUUBI #2471] [FOLLOWUP] Remove unexpected test-function.jar
- [KYUUBI #2743] colorfully kyuubi logo support
- [KYUUBI #2736] Upgrade Jackson 2.13.3
- [KYUUBI #2735] Test Spark 3.3.0-rc3
- [KYUUBI #2665] Kyuubi Spark TPC-H Connector - SupportsNamespaces
- [KYUUBI #2543] Add TPCDSTable generate benchmark
- [KYUUBI #2658] [SUBTASK] DorisSQLEngine with execute statement support
- [KYUUBI #2730] [WIP][KYUUBI #2238] Support Flink 1.15
- [KYUUBI #2663] Kyuubi Spark TPC-H Connector - Initial implementation
- [KYUUBI #2631] Rename high availability config key to support multi discovery client
- [KYUUBI #2733] [CI] Cross version verification for spark-3.3
- [KYUUBI #2285] trino’s result fetching method is changed to a streaming iterator mode to avoid hold data at server side
- [KYUUBI #2718] [KYUUBI#2405] Support Flink StringData Data Type
- [KYUUBI #2719] [SUBTASK][KPIP-4] Support internal rest request authentication to enable http request redirection across kyuubi instances
- [KYUUBI #2720] Fix KyuubiDatabaseMetaData#supportsCatalogs*
- [KYUUBI #2706] Spark extensions support Spark-3.3
- [KYUUBI #2714] Log4j2 layout pattern add date
- [KYUUBI #2686] [FOLLOWUP] Avoid potential flaky test
- [KYUUBI #2594] [FOLLOWUP] Fix flaky Test - support engine alive probe to fast fail on engine broken
- [KYUUBI #2701] Kyuubi Spark TPC-DS Connector - Rework SupportsReportStatistics and code refactor
- [KYUUBI #2712] Bump Spark master to 3.4.0-SNAPSHOT
- [KYUUBI #2541] Set nullable in table schema
- [KYUUBI #2709] Improve TPCDSTable display in Spark Web UI
- [KYUUBI #2619] Add profile spark-3.3
- [KYUUBI #2702] Fix TPC-DS columns name and add TPC-DS queries verification
- [KYUUBI #2348] Add it test for trino engine
- [KYUUBI #2686] Fix lock bug if engine initialization timeout
- [KYUUBI #2690] Make ProcessBuilder.commands immutable
- [KYUUBI #2696] [TEST] Stop NoopServer should not throw exception
- [KYUUBI #2700] Handle SPARK-37929 breaking change in TPCDSCatalog
- [KYUUBI #2683] Add INFO log in ServiceDiscovery.stopGracefully
- [KYUUBI #2694] EngineEvent.toString outputs application tags
- [KYUUBI #2594] Fix flaky Test - support engine alive probe to fast fail on engine broken
- [KYUUBI #2668] [FOLLOWUP] Remove unused Option because the collection is never null
- [KYUUBI #2675] Fix compatibility for spark authz with spark v3.3
- [KYUUBI #2680] Remove SwaggerScalaModelConverter after rest dto classes rewritten in Java
- [KYUUBI #2642] Fix flaky test - JpsApplicationOperation with spark local mode
- [KYUUBI #2668] [SUBTASK][KPIP-4] Rewrite the rest DTO classes in java
- [KYUUBI #2670] Delete the useless judgment in the extractURLComponents method of Utils.java
- [KYUUBI #2672] Check if the table exists
- [KYUUBI #2641] Client should not assume launch engine has completed on exception
- [KYUUBI #2666] Backport HIVE-24694 to Kyuubi Hive JDBC
- [KYUUBI #2661] [SUBTASK][KPIP-4] Rename GET /batches/$batchId/log to GET /batches/$batchId/localLog
- [KYUUBI #2650] Add FilteredShowColumnsCommand to AuthZ module
- [KYUUBI #2576] [FOLLOWUP] Bump Hudi 0.11.0
- [KYUUBI #2540] Kyuubi Spark TPC-DS Connector - SupportsNamespaces
- [KYUUBI #2655] Using the defined app keys for JpsApplicationOperation
- [KYUUBI #2640] Implement TGetInfoType CLI_ODBC_KEYWORDS
- [KYUUBI #2601] Add a config to support different service discovery client class implementation
- [KYUUBI #2471] Fix the bug of dynamically loading external packages
- [KYUUBI #2636] Refine BatchesResourceSuite
- [KYUUBI #2634] [SUBTASK][KPIP-4] Enhance the response error msg
- [KYUUBI #2616] Remove embedded mode support in Kyuubi Hive JDBC driver
- [KYUUBI #2605] Make SQLOperationListener configurable
- [KYUUBI #2474] [IMPROVEMENT] Add FilteredShowFunctionsCommand to Authz module
- [KYUUBI #2604] Hive Backend Engine - Multi tenancy support
- [KYUUBI #2576] Bump Hudi 0.11.0
- [KYUUBI #2473] [FOLLOWUP] Simplify FilteredShowNamespaceExec
- [KYUUBI #2621] Always use Hadoop shaded client
- [KYUUBI #2615] Add support HIVE_CLI_SERVICE_PROTOCOL_V11
- [KYUUBI #2473] [IMPROVEMENT] Add FilteredShowDatabasesCommand to AuthZ module
- [KYUUBI #2626] Replace literal by FetchType.LOG
- [KYUUBI #2614] Add commons-io to beeline module since jdbc upgraded to 3.1.3
- [KYUUBI #2539] [SUBTASK] Kyuubi Spark TPC-DS Connector - SupportsReportStatistics
- [KYUUBI #2591] Redact secret information from ProcBuilder log
- [KYUUBI #2542] [SUBTASK] Kyuubi Spark TPC-DS Connector - Make useAnsiStringType configurable
- [KYUUBI #2607] Introduce new module and setup testcontainers-based Kudu service for testing
- [KYUUBI #2333] Configuring Flink Engine heap memory and java opts
- [KYUUBI #2029] Hive Backend Engine - Operation Logs
- [KYUUBI #2609] Set Kyuubi server thrift client socket timeout to inf
- [KYUUBI #2560] Upgrade kyuubi-hive-jdbc hive version to 3.1.3
- [KYUUBI #2602] Bump testcontainers-scala 0.40.7
- [KYUUBI #2565] Variable substitution should work in plan only mode
- [KYUUBI #2493] [FOLLOWUP] Fix the exception that occurred when beeline rendered spark progress
- [KYUUBI #2378] Implement BatchesResource GET /batches/${batchId}/log
- [KYUUBI #2599] Bump scala-maven-plugin 4.6.1
- [KYUUBI #2493] Implement the progress of statement for spark sql engine
- [KYUUBI #2375] [FOLLOWUP] Implement BatchesResource GET /batches
- [KYUUBI #2588] Reformat kyuubi-hive-sql-engine/pom.xml
- [KYUUBI #2558] Fix warn message
- [KYUUBI #2427] [FOLLOWUP] Flaky test: deregister when meeting specified exception
- [KYUUBI #2582] Minimize Travis build and test
- [KYUUBI #2500] [FOLLOWUP] Resolve flink conf at engine side
- [KYUUBI #2571] Minimize YARN tests overhead
- [KYUUBI #2573] [KPIP-4][SUBTASK] Add a seekable buffered reader for random access operation log
- [KYUUBI #2375] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches
- [KYUUBI #2571] Release connection to prevent the engine leak
- [KYUUBI #2522] Even the process exit code is zero, also check the application state from resource manager
- [KYUUBI #2569] Change the acquisition method of flinkHome to keep it consistent with other engines
- [KYUUBI #2550] Fix swagger does not show the request/response schema issue
- [KYUUBI #2500] Command OptionParser for launching Flink Backend Engine
- [KYUUBI #2379] [SUBTASK][KPIP-4] Implement BatchesResource DELETE /batches/${batchId}
- [KYUUBI #2513] Support NULL type in trino engine and add QueryTests
- [KYUUBI #2403] [IMPROVEMENT] move addTimeoutMonitor to AbstractOperation because it was used in multiple engines
- [KYUUBI #2531] [SUBTASK] Kyuubi Spark TPC-DS Connector - Initial implementation
- [KYUUBI #2523] Flaky Test: KyuubiBatchYarnClusterSuite - open batch session
- [KYUUBI #2376] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches/${batchId}
- [KYUUBI #2547] Support jdbc url prefix jdbc:kyuubi://
- [KYUUBI #2549] Do not auth the request to load OpenApiConf
- [KYUUBI #2548] Prevent dead loop if the batch job submission process it not alive
- [KYUUBI #2533] Make Utils.parseURL public to remove unnecessary reflection
- [KYUUBI #2524] [DOCS] Update metrics.md
- [KYUUBI #2532] Avoid NPE in KyuubiHiveDriver.acceptsURL
- [KYUUBI #2478] [FOLLOWUP] Invoke getOpts method instead of Reflection
- [KYUUBI #2490] [FOLLOWUP] Fix and move set command test case
- [KYUUBI #2517] Rename ZorderSqlAstBuilder to KyuubiSparkSQLAstBuilder
- [KYUUBI #2025] [HIVE] Add a Hive on Yarn doc
- [KYUUBI #2032] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - SetClientInfo
- [KYUUBI #2490] Fix NPE in getOperationStatus
- [KYUUBI #2516] [DOCS] Add Contributor over time in README.md
- [KYUUBI #2346] [IMPROVEMENT] Simplify FlinkProcessBuilder with java executable
- [KYUUBI #2472] Support FilteredShowTablesCommand for AuthZ module
- [KYUUBI #2309] [SUBTASK][KPIP-4] Implement BatchesResource POST /batches
- [KYUUBI #2028] [FOLLOWUP] add engine stop event and fix the partition of initialized event
- [KYUUBI #2512] Fix broken link of IntelliJ IDEA Setup Guide
- [KYUUBI #2450] [FOLLOWUP] Remove opHandle from opHandleSet when exception occurs
- [KYUUBI #2510] Fix NPE when invoking YarnApplicationOperation::getApplicationInfoByTag
- [KYUUBI #2496] Prevent empty auth user when anonymous is allowed
- [KYUUBI #2498] Upgrade Delta version to 1.2.1
- [KYUUBI #2419] Release engine during closing kyuubi server session if share level is connection
- [KYUUBI #2487] Fix test command to make it runnable
- [KYUUBI #2457] Fix flaky test: engine log truncation
- [KYUUBI #2478] Backport HIVE-19018 to Kyuubi Beeline
- [KYUUBI #2020] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - TGetQueryId
- [KYUUBI #2484] Add conf to SessionEvent and display it in EngineSessionPage
- [KYUUBI #2433] HiveSQLEngine load required jars from HIVE_HADOOP_CLASSPATH
- [KYUUBI #2477] Change state early on stopping
- [KYUUBI #2451] Support isWrapperFor and unwrap
- [KYUUBI #2453] [IMPROVEMENT] checkValue of TypedConfigBuilder shall also print the config name
- [KYUUBI #2427] Flaky test: deregister when meeting specified exception
- [KYUUBI #2456] Supports managing engines of different share level in kyuubi-ctl
- [KYUUBI #1987] Support preserve user context in group/server share level
- [KYUUBI #2467] Remove close launchEngineOp
- [KYUUBI #2440] [IMPROVEMENT] spark engine event add endTime when it is stopped
- [KYUUBI #2461] Use the original host argument
- [KYUUBI #2463] Redact
kyuubi.ha.zookeeper.auth.digest
in Spark engine - [KYUUBI #2445] Implement ApplicationManager and Yarn/ JPS-local Application Operation
- [KYUUBI #1936] [FOLLOWUP] Stop updating credentials when credentials are expired
- [KYUUBI #2450] Update lastAccessTime in getStatus and add opHandle to opHandleSet before run
- [KYUUBI #2439] Using Pure Java TPC-DS generator
- [KYUUBI #2448] Log the engine id when opening Kyuubi connection
- [KYUUBI #2436] Add AlterTableRecoverPartitionsCommand for Spark Sql Authz PrivilegesBuilder
- [KYUUBI #2432] [DOCS] button “Download” is invalid
- [[KYUUBI #2429] KYUUBI #2416] Increase Test Coverage For Privileges Builder](https://github.com/apache/incubator-kyuubi/commit/14f675d2)
- [KYUUBI #2344] [IMPROVEMENT] Add Kyuubi Server on Kubernetes with Spark Cluster mode integration test
- [KYUUBI #2201] Show ExecutionId when running status on query engine page
- [KYUUBI #2424] [IMPROVEMENT] add Flink compile version and Trino client compile version to KyuubiServer Log
- [KYUUBI #2253] [IMPROVEMENT] Trino Engine - Events support
- [KYUUBI #2426] Return complete error stack trace information
- [KYUUBI #2410] [IMPROVEMENT] Fix docker-image-tool.sh example version to 1.4.0
- [KYUUBI #2351] Fix Hive Engine terminating blocked by non-daemon threads
- [KYUUBI #2422] Wrap close session with try-finally
- [KYUUBI #2420] Fix outdate .gitignore for dependency-reduced-pom.xml
- [KYUUBI #2368] [IMPROVEMENT] Command OptionParser for launching Trino Backend Engine
- [KYUUBI #2021] [FOLLOWUP] Move derby workaround to test code
- [KYUUBI #2301] Limit the maximum number of concurrent connections per user and ipaddress
- [KYUUBI #2323] Separate events to a submodule - kyuubi-event
- [KYUUBI #2289] Use unique tag to kill applications
- [KYUUBI #2021] Command OptionParser for launching Hive Backend Engine
- [KYUUBI #2414] [KYUUBI apache#2413 ] Fix InsertIntoHiveTableCommand case in PrivilegesBuilder#buildCommand()
- [KYUUBI #2406] Add Flink environments to template
- [KYUUBI #2355] Bump Delta Lake 1.2.0
- [KYUUBI #2349] [DOCS] Usage docs for kyuubi-ctl
- [KYUUBI #2381] [Test] Add Kyuubi on k8s With Spark on k8s client deploy-mode unit test
- [KYUUBI #2390] RuleEliminateMarker stays in analyze phase for data masking
- [KYUUBI #2395] [DOC] Add Documentation for Spark AuthZ Extension
- [KYUUBI #2397] Supports managing engines of different versions in kyuubi-ctl
- [KYUUBI #2402] [IMPROVEMENT] addTimeoutMonitor for trino engine when it run query async
- [KYUUBI #2360] [SUBTASK] Configuring Hive engine heap memory and java opts
- [KYUUBI #2399] Fix PrivilegesBuilder Build Wrong PrivilegeObjets When Query Without Project But With OrderBy/PartitionBy
- [KYUUBI #2308] [SUBTASK][KPIP-4] Batch job configuration ignore list and pre-defined configuration in server-side
- [KYUUBI #2369] [IMPROVEMENT] update developer.md to describe what append descriptions of new configurations to settings.md
- [KYUUBI #2391] Fix privileges builder return wrong result when there is no project but has filter/join
- [KYUUBI #2361] [IMPROVEMENT] Configuring Trino Engine heap memory and java opts
- [KYUUBI #2338] [DOCS] Upgrade sphinx dependencies for documentation build
- [KYUUBI #2385] Export JAVA_HOME. It seems TravisCI stopped doing it recently
- [KYUUBI #2353] [SUBTASK][KPIP-4] Implement BatchJobSubmission operation and basic KyuubiBatchSessionImpl
- [KYUUBI #2359] [Test] Build WithKyuubiServerOnKuberntes
- [KYUUBI #2330] [SUBTASK] Hive Backend Engine - GetTypeInfo Operation
- [KYUUBI #2257] Replace replace conf vars with strings in HiveSQLEngine
- [KYUUBI #2248] [DOCS] Add a flink on yarn kerberos doc
- [KYUUBI #1451] Support Data Column Masking
- [KYUUBI #2357] [IMPROVEMENT] Add warn log and check in class of HiveProcessBuilder
- [KYUUBI #2328] Support getting mainResource in the module target directory of KYUUBI_HOME
- [KYUUBI #2354] Fix NPE in process builder log capture thread
- [KYUUBI #2337] [DOCS] Access Kyuubi with Kyuubi JDBC Driver
- [KYUUBI #2331] Add createSession method to further abstract openSession
- [KYUUBI #2347] Output trino query id within query execute
- [KYUUBI #2345] [DOC] Hot Upgrade Kyuubi Server
- [KYUUBI #2336] Simplify TrinoProcessBuilder with java executable
- [KYUUBI #2343] [KYUUBI#2297] HiveEngineEvent toString is not pretty
- [KYUUBI #1989] Decouple curator from other modules
- [KYUUBI #2324] [SUBTASK][KPIP-4] Implement SparkBatchProcessBuilder to submit spark batch job
- [KYUUBI #2329] [KYUUBI#2214][FOLLOWUP] Cleanup kubernetes-deployment-it
- [KYUUBI #2216] [Test] [K8s] Add Spark Cluster mode on Kubernetes integration test
- [KYUUBI #2024] [FOLLOWUP] Hive Backend Engine - ProcBuilder for HiveEngine
- [KYUUBI #2281] The RenewDelegationToken method of TFrontendService should return SUCCESS_STATUS by default
- [KYUUBI #2300] Add http UGIAssuming handler wrapper for kerberos enabled restful frontend service
- [KYUUBI #2292] [FOLLOWUP] Unify kyuubi server plugin location
- [KYUUBI #2320] Make the CodeSource location correctly obtained on Windows
- [KYUUBI #2316] [DOCS] Fix typo in GitHub issue template
- [KYUUBI #2317] [BUILD] Bump hive-service-rpc 3.1.3 version
- [KYUUBI #2311] Refine github label
- [KYUUBI #2310] Make ranger extension work with mac m1
- [KYUUBI #2312] Spark data type TimestampNTZ supported version changes as 3.4.0
- [KYUUBI #2296] Fix operation log file handler leak
- [KYUUBI #2250] Support to limit the spark engine max running time
- [KYUUBI #2299] Fix flaky test: support engine alive probe to fast fail on engine broken
- [KYUUBI #2292] Unify kyuubi server plugin location
- [KYUUBI #2292] Unify spark extension location
- [KYUUBI #2084] [FOLLOWUP] Support arbitrary parameters for KyuubiConf
- [KYUUBI #2287] Revamp Flink IT by random port and merge tests
- [KYUUBI #1451] Add Row-level filtering support
- [KYUUBI #2280] [INFRA] Replace BSD 3-clause with ASF License v2 for scala binaries
- [KYUUBI #2277] Inline kyuubi prefix in KyuubiConf
- [KYUUBI #2266] The default value of frontend.connection.url.use.hostname should be set to true to be consistent with previous versions
- [KYUUBI #2260] The running query will not update the duration of the page
- [KYUUBI #2272] Fix incorrect doc link
- [KYUUBI #2268] Flaky test: submit spark app timeout with last log output
- [KYUUBI #2275] [DOCS] Fix missing prefix in trino engine quick start
- [KYUUBI #2243] [DOCS] Add quick start for trino engine
- [KYUUBI #2255] The engine state of Spark’s EngineEvent is hardcoded with 0
- [KYUUBI #2263] [KYUUBI #2262]Kyuubi Spark Nightly failed - select timestamp_ntz *** FAILED ***
- [KYUUBI #2209] Add detail usage documents of Flink engine
- [KYUUBI #2246] [BUILD] Pick Commons-Logging dependence out of Hudi-Common
- [KYUUBI #2028] Hive Backend Engine - Events support
- [KYUUBI #2207] Fix DayTimeIntervalType/YearMonthIntervalType Column Size
- [KYUUBI #1451] Introduce Kyuubi Spark AuthZ Module with column-level fine-grained authorization
- [KYUUBI #1798] Add EventBus module to unify the distribution and subscription of Kyuubi’s events
- [KYUUBI #2207] Support newly added spark data types: TimestampNTZType
- [KYUUBI #1021] Expire CredentialsRef in a proper time to reduce memor…
- [KYUUBI #2241] Remove unused deployment documents of Spark
- [KYUUBI #2244] load-kyuubi-env.sh should print SPARK_ENGINE_HOME for consistent
- [KYUUBI #2023] Hive Backend Engine - Shade HiveSQLEngine runtime
- [KYUUBI #1498] Support operation log for ExecuteScala
- [KYUUBI #2087] Add issue template for documentation improvement
- [KYUUBI #1962] Add timeout check for createSpark
- [KYUUBI #2218] Fix maven options about hive-provided
- [KYUUBI #2225] Support to set result max rows for spark engine
- [KYUUBI #2008] [FOLLOWUP] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2231] Close action and default sparksession before
createSpark
. - [KYUUBI #2222] Refactor the log when failing to get hadoop fs delegation token
- [KYUUBI #2227] Fix operation log dir not deleted issue
- [KYUUBI #2223] Return the last rows of log for prompts even exception detected
- [KYUUBI #2221] Shade hive-service-rpc and thrift in Spark engine
- [KYUUBI #2102] Support to retry the internal thrift request call and add engine liveness probe to enable fast fail before retry
- [KYUUBI #2207] Support newly added spark data types: DayTimeIntervalType/YearMonthIntervalType
- [KYUUBI #2085] [FOLLOWUP] Fix kyuubi-common wrong label
- [KYUUBI #2208] Fixed session close operator log session dir not deleted
- [KYUUBI #2214] Add Spark Engine on Kubernetes integration test
- [KYUUBI #2203] [FLINK] Support flink conf set by kyuubi conf file
- [KYUUBI #2197] [BUILD] Bump jersey 2.35 version
- [KYUUBI #2204] Make comments consistent with code in EngineRef
- [KYUUBI #2186] Manage test failures with kyuubi spark nightly build - execute statement - select interval
- [KYUUBI #2195] Using while-loop or for-loop instead of map/range to improve performance in RowSet
- [KYUUBI #2033] Hive Backend Engine - GetCrossReference
- [KYUUBI #2135] Build and test all modules on Linux ARM64
- [KYUUBI #2035] Hive Backend Engine -
build/dist
support - [KYUUBI #2189] Manage test failures with kyuubi spark nightly build - deregister when meeting specified exception *** FAILED ***
- [KYUUBI #2119] [FOLLOWUP] Support output progress bar in Spark engine
- [KYUUBI #2187] Manage test failures with kyuubi spark nightly build - execute simple scala code *** FAILED ***
- [KYUUBI #2184] Manage test failures with kyuubi spark nightly build - operation listener *** FAILED ***
- [KYUUBI #2034] Hive Backend Engine - GetPrimaryKeys
- [KYUUBI #2163] [K8s] copy beeline-jars into docker image
- [KYUUBI #2175] Improve CI with cancel & concurrency & paths filter
- [KYUUBI #2172] [BUILD] Bump Flink 1.14.4 version
- [KYUUBI #2159] [FLINK] Prevent loss of exception message line separator
- [KYUUBI #2024] Hive Backend Engine - ProcBuilder for HiveEngine
- [KYUUBI #2017] Hive Backend Engine - GetColumns Operation
- [KYUUBI #2019] Hive Backend Engine - GetTableTypes Operation
- [KYUUBI #2018] Hive Backend Engine - GetFunctions Operation
- [KYUUBI #2156] [FOLLOWUP] Fix configuration format in document
- [KYUUBI #2119] Support output progress bar in Spark engine
- [KYUUBI #2016] Hive Backend Engine - GetTables Operation
- [KYUUBI #2156] Change log to reflect exactly why getting token failed
- [KYUUBI #2148] [DOCS] Add dev/reformat usage
- [KYUUBI #2150] [DOCS] Fix Getting Started With Kyuubi on Kubernetes
- [KYUUBI #2143] [KYUBBI #2142][DOCS] Add IDEA setup guide
- [KYUUBI #2015] Hive Backend Engine - GetSchemas Operation
- [KYUUBI #1936] [FOLLOWUP] Send credentials when opening session and wait for completion
- [KYUUBI #2085] [FOLLOWUP] Fix the wrong path of
module:hive
- [KYUUBI #2134] Respect Spark bundled log4j in extension modules
- [KYUUBI #2014] Hive Backend Engine - GetCatalog Operation
- [KYUUBI #2129] FlinkEngine throws UnsupportedOperationException in GetColumns
- [KYUUBI #2022] Hive Backend Engine - maven-google-downloader plugin support for hive distribution
- [KYUUBI #2084] Support arbitrary parameters for KyuubiConf
- [KYUUBI #2112] Improve the compatibility of queryTimeout in more version clients
- [KYUUBI #2115] Update license and enhance collect_licenses script
- [KYUUBI #2085] Add a labeler github action to triage PRs
- [KYUUBI #1866] [FOLLOWUP] Add Deploy Kyuubi Flink engine on Yarn
- [KYUUBI #2120] Optimize RenewDelegationToken logs in Spark engine
- [KYUUBI #2104] Kill yarn job using yarn client API when kyuubi engine …
- [KYUUBI #2118] [SUBTASK][KPIP-2] Support session jars management
- [KYUUBI #2127] avoid to set HA_ZK_NAMESPACE and HA_ZK_ENGINE_REF_ID repetitively when create flink sql engine
- [KYUUBI #2123] Output engine information after openEngineSession call fails
- [KYUUBI #2125] closeSession should avoid sending RPC after openSession fails
- [KYUUBI #2116] move toString() to ProcBuilder trait from its implements
- [KYUUBI #1866] [FOLLOWUP] Add logging of Flink SQL Engine
- [KYUUBI #1866] [DOCS] Add flink sql engine quick start
- [KYUUBI #2108] Add description about trino in the config of engine.type
- [KYUUBI #2071] Using while-loop instead of map/range to improve performance in RowSet
- [KYUUBI #2070] [FLINK] Support Flink job submission on yarn-session mode
- [KYUUBI #2089] Add debugging instructions for Flink engine
- [KYUUBI #2097] [CI] Upload Test Log for CI failure shall contain trino engine log #2094
- [KYUUBI #2095] Remove useless logic about add conf when create a new engine
- [KYUUBI #1948] [FOLLOWUP] Relocate fb303 classes
- [KYUUBI #1978] Support NEGOTIATE/BASIC authorization for restful frontend service
- [KYUUBI #2081] YARN_CONF_DIR shall be added to kyuubi server classpath as HADOOP_CONF_DIR
- [KYUUBI #2078]
logCaptureThread
does not catch sparksubmit exception - [KYUUBI #1936] Send credentials when opening session and wait for completion
- [KYUUBI #2079] Update kyuubi layer source file to add flink and trino…
- [KYUUBI #1563] Fix broken link and add new link in
CONTRIBUTION.md
- [KYUUBI #2072] Improve rest server behavior
- [KYUUBI #2075] Using thread-safe FastDateFormat instead of SimpleDateFormat
- [KYUUBI #2066] Fix spelling mistake and appropriate naming
- [KYUUBI #2063] Fix engine idle timeout lose efficacy for Flink Engine
- [KYUUBI #2061] Implementation of the very basic UI on current Jetty server
- [KYUUBI #2011] Introduce to very basic hive engine
- [KYUUBI #1215] [DOC] Document incremental collection
- [KYUUBI #2043] Upgrade log4j/2.x/ to 2.17.2
- [KYUUBI #2060] Clear job group for init SQL
- [KYUUBI #2044] Remove authentication thread local objects to prevent memory leak
- [KYUUBI #1955] Add CI for branch-1.5 & 1.4 SNAPSHOTS
- [KYUUBI #2054] [KYUUBI-1819] Support closing Flink SQL engine process
- [KYUUBI #2055] correct the log service name
- [KYUUBI #2047] Support more MySQL JDBC driver versions
- Ada Wong
- BoYang
- Brandon Grams
- Cheng Pan
- Deng An
- Fei Wang
- Fu Chen
- Kent Yao
- Luning Wang
- Mahmoud Bahaa
- Martin Tzvetanov Grigorov
- Min Zhao
- Nick Song
- ParisaTork
- Paul Lin
- Shengkai Fang
- Nicholas Jiang
- Tianlin Liao
- Wang Zhen
- Xiao Zhao
- benjobs
- gabrywu
- guanhua.lgh
- hongdongdong
- jason
- jiadongdong
- jiaoqingbo
- liangbowen
- liaoyt
- liuzy04
- lxorc
- maming
- odone
- packyan
- pengqli
- senmiaoliu
- sychen
- taokelu
- Xiduo You
- wangjunbo
- Zhen Wang
- winfys
- xsun4
- Vino Yang
- yangrong688
- yikf
- zhangliang
- zhangrenhua
- zhanqian
- zhouyifan279
- zwangsheng
- [KYUUBI #2841] [1.5] Revert “[KYUUBI #2211] [Improvement] Add CHANGELOG.md to codebase for maintaining release notes”
- [KYUUBI #2746][INFRA][1.5] Improve NOTICE of binary release
- [KYUUBI-2422] Wrap close session with try-finally (#2836)
- [KYUUBI #2227] Fix operation log dir not deleted issue
- [KYUUBI #2208] Fixed session close operator log session dir not deleted
- [KYUUBI #2211] [Improvement] Add CHANGELOG.md to codebase for maintaining release notes
- [KYUUBI #2736] Upgrade Jackson 2.13.3
- [KYUUBI #2720] Fix KyuubiDatabaseMetaData#supportsCatalogs*
- [KYUUBI #2686][1.5] Fix lock bug if engine initialization timeout
- [KYUUBI #2640] Implement TGetInfoType CLI_ODBC_KEYWORDS
- [KYUUBI #2450][FOLLOWUP] Remove opHandle from opHandleSet when exception occurs
- [KYUUBI #2478] Backport HIVE-19018 to Kyuubi Beeline
- [KYUUBI #2484] Add conf to SessionEvent and display it in EngineSessionPage
- [KYUUBI #2450] Update lastAccessTime in getStatus and add opHandle to opHandleSet before run
- Cheng Pan
- Fei Wang
- jiaoqingbo
- winfys
- Xiduo You
- yangrong688
- Zhen Wang
- [KYUUBI #2354] Fix NPE in process builder log capture thread
- [KYUUBI #2296] Fix operation log file handler leak
- [KYUUBI #2266] The default value of frontend.connection.url.use.hostname should be set to true to be consistent with previous versions
- [KYUUBI #2255]The engine state of Spark’s EngineEvent is hardcoded with 0
- [KYUUBI #2008][FOLLOWUP] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2156][FOLLOWUP] Fix configuration format in document
- [KYUUBI #2156] Change log to reflect exactly why getting token failed
- [KYUUBI #2134] Respect Spark bundled log4j in extension modules
- [KYUUBI #2150] [DOCS] Fix Getting Started With Kyuubi on Kubernetes
- Cheng Pan
- Fei Wang
- HYBG
- Nick-0723
- cxzl25
- jiaoqingbo
- ulysses
- 支持 Flink SQL 引擎 (Beta)
- 支持 Trino/ Presto 引擎 (Beta)
- 支持为 Spark SQL 引擎运行 Scala
- 将 Hive 服务 RPC 协议升级到 3.1.2
- 引擎启动过程默认切换到异步
- 将 Session Conf Provider 添加为 Developer API
- 正确性 - 修复 Spark SQL 的浮点精度损失
- 从 log4j1 迁移到 log4j2
- [KYUUBI #1936][FOLLOWUP] Send credentials when opening session and wait for completion
- [KYUUBI #2115][1.5] Update license and enhance collect_licenses script
- [KYUUBI #2125] closeSession should avoid sending RPC after openSession fails
- [KYUUBI #2103] [1.5] Revert “[KYUUBI #1948] Upgrade thrift version to 0.16.0”
- [KYUUBI #1866][FOLLOWUP] Add logging of Flink SQL Engine
- [KYUUBI #1866][DOCS] Add flink sql engine quick start
- [KYUUBI #2070][FLINK] Support Flink job submission on yarn-session mode
- [KYUUBI #2089] Add debugging instructions for Flink engine
- [KYUUBI #1948][FOLLOWUP] Relocate fb303 classes
- [KYUUBI #2078]
logCaptureThread
does not catch sparksubmit exception - [KYUUBI #1936] Send credentials when opening session and wait for completion
- [KYUUBI #2079] Update kyuubi layer source file to add flink and trino…
- [KYUUBI #2075] Using thread-safe FastDateFormat instead of SimpleDateFormat
- [KYUUBI #2063] Fix engine idle timeout lose efficacy for Flink Engine
- [KYUUBI #1215][DOC] Document incremental collection
- [KYUUBI #2043] Upgrade log4j/2.x/ to 2.17.2
- [KYUUBI #2060] Clear job group for init SQL
- [KYUUBI #2054] [KYUUBI-1819] Support closing Flink SQL engine process
- [KYUUBI #2055] correct the log service name
- [KYUUBI #2047] Support more MySQL JDBC driver versions
- [KYUUBI #2012] rename EventLoggingService and creates an correct directory
- [KYUUBI #2042] [KYUUI #2036] Redirect Issues/PR Notifications to notifications@kyuubi.apache.org
- [KYUUBI #2039] Remove LegacyFlinkOperationSuite
- [KYUUBI #1961] Upgrade
hive-service-rpc
to 3.1.2 - [KYUUBI #2008] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2006] Improve the readability of ServiceControl list/get operations
- [KYUUBI #1999] Update quick_start_with_helm.md
- [KYUUBI #2000][DEPS] Bump Hadoop 3.3.2
- [KYUUBI #2004] Sync contents for CONTRIBUTING & COMMUNITY between web and main repo
- [KYUUBI #1996] Clean up log4j2 conf and enhance surefire plugin conf
- [KYUUBI #1986] Apache Kyuubi(Incubating) Maturity Self Assessment
- [KYUUBI #1988] Tune initialization of vars depend on system level confs
- [KYUUBI #1992] Remove SPARK_HOME predication.
- [KYUUBI #1960] Skip creating sparksession and starting engine if the max initialization time exceeds
- [KYUUBI #1958] Fix flaky test: statement redact for engine tab
- [[KYUUBI #1983] [KYUUBI #1806][FOLLOWUP] Fix LaunchEngine may be closed multiple times
- [KYUUBI #1981] Remove unused artifacts for common and parent module
- [KYUUBI #1972] Fix flaky test: SchedulerPoolSuite: Scheduler pool
- [KYUUBI #1969] Fix race on some service during start and stop phase
- [KYUUBI #1979] Simplify Kyuubi Event
- [KYUUBI #1975] [BUILD] Run TPC-DS test using the default Spark version
- [KYUUBI #1974] Support merge small files in multi insert statement
- [KYUUBI #1963] Make plan only mode skippable for configuable plans
- [KYUUBI #1970] Replace mirror-cn profile with Apache officially suggested dlcdn
- [KYUUBI #1948][FOLLOWUP] Remove TFramedTransport in extension-spark-3-1 and extension-spark-3-2
- [KYUUBI #1965] [DOCS] Use the newly added official logo at asf svn in README
- [KYUUBI #1948] Upgrade thrift version to 0.16.0
- [KYUUBI #1964] [BUILD] Update scalatest.exclude.tags
- [KYUUBI #1883] Support max result rows for Flink queries
- [KYUUBI #1920] Skip the Plan parsing of UseStatement
- [KYUUBI #1944] Upgrade Spark 3.1.3
- [KYUUBI #1957] Skip html comments in merge commit test body from PR desc
- [KYUUBI #1947] Revamp Github Action settings for CI
- [KYUUBI #1950] Remove ambiguous SPARK_HADOOP_VERSION
- [KYUUBI #1949] [INFA] Add homepage for every module in maven central
- [KYUUBI #1946] Close the kyuubi connection on launch engine operation failure
- [KYUUBI #1918] Build and test on Linux ARM64
- [KYUUBI #1945] [BUILD] Remove spark-hadoop from matrix to simplify workflow
- [KYUUBI #1940] [TEST] Fix EngineSecurityAccessorSuite
- [KYUUBI #1876][FOLLOWUP] Update iceberg.name
- [KYUUBI #1937] Build: Use Spark 3.2 for cross version verification
- [KYUUBI #1939] Build: Bump Jacoco maven plugin 0.8.7
- [KYUUBI #1796] Destroy the process after the engine starts
- [KYUUBI #1931]
AbstractSession._lastIdleTime
should be reset in acquire method - [KYUUBI #1919] Add more enum values for
OperationModes
- [KYUUBI #1930] Export TRINO_ENGINE_HOME in load-kyuubi-env script
- [KYUUBI #1926] Remove useless constants in Constants
- [KYUUBI #1923] Add GetFunctions for trino engine
- [KYUUBI #1906] Add GetColumns for trino engine
- [KYUUBI #1914] Update metric doc
- [KYUUBI #1867] Support
PlanOnlyStatement
operation like Spark SQL engine - [KYUUBI #1911] Add GetTypeInfo for trino engine
- [KYUUBI #1876] Set Spark 3.2.1 as default
- [KYUUBI #1536] Add session conf advisor
- [KYUUBI #1899] Bump Iceberg 0.13.1
- [KYUUBI #1887] Add GetTables for trino engine
- [KYUUBI #1909] [DOCS] Remove unnecessary docs link in readme
- [KYUUBI #1886] Add GetSchemas for trino engine
- [KYUUBI #1905] log4j2-defaults.properties is not working since log4j 2 is always intialized by default
- [KYUUBI #1908] Codecov for flink/trino/beeline/jdbc modules
- [KYUUBI #1903] Add GetTableTypes for trino engine
- [KYUUBI #1901] [GA] Fix checkout version
- [KYUUBI #1898] Enhance release guide add more information about how to…
- [KYUUBI #1896] Make
Query Details
andFailure Reason
sortable on the Kyuubi Query Engine page - [KYUUBI #1811] TPC-DS benchmark expose cli args breakdown and results-dir
- [KYUUBI #1893] Bump Delta 1.0.1
- [KYUUBI #1880] Fixed: forcedMaxOutputRows extension for join
- [KYUUBI #1889] Improve the user experience of the configuration parameters of the document
- [KYUUBI #1885] Add GetCatalogs for trino engine
- [KYUUBI #1821] Add trino ExecuteStatement
- [KYUUBI #1884] Fix compile SQL measurement
- [KYUUBI #1816] Implement KyuubiHistoryServerPlugin
- [KYUUBI #1873] Fix incorrect applicationId
- [KYUUBI #1878] Fix typo in log4j2-test.properties
- [KYUUBI #1838] Clean up query results after query operations finish
- [KYUUBI #1868] Upgrate netty from 4.1.68 to 4.1.73
- [KYUUBI #1872] Make ProcBuilder decouple with YARN
- [KYUUBI #1875] Upgrade codahale.metrics.version to 4.2.8 and its deps
- [KYUUBI #1870] Upgrate k8s client from 5.5.0 to 5.12.1
- [KYUUBI #1871] Upgrade minikube action from 2.4.2 to 2.4.3
- [KYUUBI #1804][FOLLOWUP][GA] Avoid push docker image for forked repos
- [KYUUBI #1844] Add step for generating release notes
- [KYUUBI #1849] Bump Iceberg 0.13.0 and enable Iceberg test with Spark 3.2
- [KYUUBI #1861] Migrate bind-api and activation-api from javax to jakarta
- [KYUUBI #1848] Bump Spark 3.2.1
- [KYUUBI #1769][FOLLOWUP] Exclude log4j 12 deps from spark-hive and fix detect deps change workflow
- [KYUUBI #1769][FOLLOWUP] Revert the dependency change for kyuubi-hive-jdbc(shaded) modules
- [KYUUBI #1846] Add
improvement
issue template - [KYUUBI #1858] Rename test log4j2 properties to log4j2-test.properties
- [KYUUBI #1850] Bump Prometheus 0.14.1
- [KYUUBI #1855] Suppress logging to console in scalatest
- [KYUUBI #1847] Bump Flink 1.14.3
- [KYUUBI #1829] Support executing statement async for Flink SQL engine
- [KYUUBI #1852] Fix UT property of log4j2 conf
- [KYUUBI #1769][FOLLOWUP] Some cleanups for log4j properties
- [KYUUBI #1839] Minor refactor OperationUtil
- [KYUUBI #1813] Enable the internal secure authentication between Kyuubi server and engine
- [KYUUBI #1769] [BUILD] Migrate from log4j1 to log4j2
- [KYUUBI #1832] Fixed: forcedMaxOutputRows extension for subquery
- [KYUUBI #1836] [RELEASE] Enhance release guide
- [KYUUBI #1840] Minor fix for general_incubator_vote script
- [KYUUBI #1834] [BUILD] Add support of external mvn with default mvn jvm opts when making distribution
- [KYUUBI #1835] Fix error to helm manifest
- [KYUUBI #1786] Fix the Spark sql engine logger level changed to WARN issue
- [KYUUBI #1685] Support jar and lib start option
- [KYUUBI #1778] Support Flink Set/Reset Operations
- [KYUUBI #1825] Generate appName for Flink applications
- [KYUUBI #1831] [DOCS] Fix the jdbc connection url format doc
- [KYUUBI #1610] Rest frontend service jetty server has started at null
- [KYUUBI #1806] Fix LaunchEngine may be closed multiple times
- [KYUUBI #1698] Add kyuubi server operation state rate
- [KYUUBI #1808] Update the link in the PULL_REQUEST_TEMPLATE
- [KYUUBI #1800] Remove oom hook
- [KYUUBI #1780] Log error message on REST endpoints
- [KYUUBI #1784][FOLLOWUP][TRINO] Fix float types lose precision
- [KYUUBI #1784][FOLLOWUP][FLINK] Support float type
- [KYUUBI #1797] Only exposing jdbc url for server side
- [KYUUBI #1804]Avoid nightly build for forked repos
- [KYUUBI #1764] Reuse the workingDir in ProcBuilder
- [KYUUBI #1699] Improve codahale metric
- [KYUUBI #1784] Fix float types lose precision
- [KYUUBI #1787] Export FLINK_ENGINE_HOME in load-kyuubi-env script
- [KYUUBI #1774] Export FLINK_HOME in load-kyuubi-env script
- [KYUUBI #1775] Add kyuubi.server.name configuration
- [KYUUBI #1785] Stop Discovery services properly
- [KYUUBI #1643][FOLLOWUP] Fix Flink GetFunctions result schema
- [KYUUBI #1788] Update greetings.yml
- [KYUUBI #1776] Improve EnginePage
- [KYUUBI #1648] Implement Flink GetTypeInfo operation
- [KYUUBI #1771] Change rate unit in
JsonReporterService
- [KYUUBI #1696] Add fetch logs and results rows rate
- [KYUUBI #1704] Complete Flink-Hive data type mapping
- [KYUUBI #1645] Implement Flink engine GetSchemas operation
- [KYUUBI #1714] Add executeScala api for KyuubiStatement
- [KYUUBI #1756] Clean up code of FlinkOperation
- [KYUUBI #1766] [TEST] Remove SessionManagerSuite to reduce duplicated tests
- [KYUUBI #1763] [INFRA] Remove scala installation in
build/mvn
and using warn level for the ci - [KYUUBI #1643] Implement GetFunctions operation
- [KYUUBI #1761] [SubTask][THTTP] Make abstract TFrontendService for thrift http protocol support
- [KYUUBI #1757] Extract workingDir from engine specific process builde…
- [KYUUBI #1510] Add TRINO engine type and TrinoProcessBuilder
- [KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
- [KYUUBI #1759] Remove duplicate close operation api
- [KYUUBI #1731][FEATURE][FOLLOWUP] Use validated HadoopFs URI in HadoopFsDelegationTokenProvider#obtainDelegationTokens
- [KYUUBI #1738] Unify kubernetes integration test
- [KYUUBI #1660] Add restart option for bin/kyuubi
- [KYUUBI #1746] Move sparkEngineMajorMinorVersion into SparkQueryTests to make HiveJDBCTestHelper spark free
- [KYUUBI #1743] Fix parallelism of DataGenerator and other enhancements
- [KYUUBI #1740] Use testcontainers scalatest in trino module
- [KYUUBI #1745] [KYUBBI #1744] Fix trino client flaky test
- [KYUUBI #1737] [WIP][KYUUBI #1731][FEATURE] Kyuubi server should not fail to start when Hadoop FileSystem class not found
- [KYUUBI #1716] Unify Hive deps for server and client
- [KYUUBI #1729] Extract java lint workflow to a single yml and disable it in other jobs
- [KYUUBI #1735] [CI] Add current ip address, long hostname and short hostname to /etc/hosts
- [KYUUBI #1736] Bump up GA actions/checkout to latest (v2.3.5)
- [KYUUBI #1732] Reduce spark driver memory configuration to protect fa…
- [KYUUBI #1730] Use getHostName instead of getCanonicalHostName
- [KYUUBI #1672] Add VersionInfo in REST API
- [KYUUBI #1726] Extract dep workflow to a single yml and disable it in other jobs
- [KYUUBI #1719] javax.activation:activation:jar duplicates
- [KYUUBI #1720] Extract scalastyle workflow to a single yml and disable it in other jobs
- [KYUUBI #1646] support flink get tables
- [KYUUBI #1723] Create greetings.yml
- [KYUUBI #1722] [NOTICE] Update NOTICE for 2022
- [KYUUBI #1721] Recover maven deplop plugin in all module
- [KYUUBI #1709] Introduce a IT module for Kyuubi and FlinkSQL Engine t…
- [KYUUBI #1718] Extract rat workflow to a single yml and disable it in other jobs
- [KYUUBI #1717] Extract rat configurations from pom to file
- [KYUUBI #1715] For kyuubi-beeline, using kyuubi-hive-jdbc instead of kyuubi-hive-jdbc-shaded
- [KYUUBI #1712] Bump up maven.version to 3.8.4
- [KYUUBI #1710] Support to specify OPERATION_LANGUAGE with TExecuteStatementReq confOverlay
- [KYUUBI #1647] Change GetCatalog returned schema key name to support JDBC specification
- [KYUUBI #1690] Checking whether launchEngineOpHandle is null for KyuubiConnection:: getExecLog
- [KYUUBI #1697] BackendService method avg call times and rate
- [KYUUBI #1681] Extend Flink ExecuteStatement to support more operations
- [KYUUBI #1705] Support decimal type for Flink SQL Engine
- [KYUUBI #1691] Implement api: /${version}/operations/${operation_identifier}/rowset
- [KYUUBI #1641] Add Trino client
- [KYUUBI #1647] Implement GetTableTypes operation
- [KYUUBI #1477] Use KyuubiHadoopUtils.newHadoopConf instead of new Con…
- [KYUUBI #1678] Fixed: The value of hasResultSet is always set to true in Kyuubi Server
- [KYUUBI #1679] Remove invalid column and field number check
- [KYUUBI #1673] [BUILD] Improve log4j configurations
- [KYUUBI #1568] [FOLLOWUP] Add getSessionEvent in session
- [KYUUBI #1675][FEATURE] Redact secret information from SparkSQLEngine log
- [KYUUBI #1674] Uncache cached tables when session closed
- [KYUUBI #1654][Bug] Flaky OperationsResourceSuite
- [KYUUBI #1665][FOLLOWUP] Rename FlinkEngineProcessBuilder to FlinkProcessBuilder to align with SparkProcessBuilder
- [KYUUBI #1594] SparkProcessBuild submit add –conf spark.driver.host=
- [KYUUBI #1665] Rename FlinkEngineProcessBuilder to FlinkProcessBuilder to align with SparkProcessBuilder
- [KYUUBI #1656] Fix dist failed with –spark-provided
- [KYUUBI #1658] Revamp swagger ui dependencies
- [KYUUBI #1662] Turn up maven options in mvn script
- [KYUUBI #1597] fix row value in Query Execution should be queryExecution
- [KYUUBI #1649] Determine the yarn command in stop-application.sh.
- [KYUUBI #1634][FEATURE] Redact secret information from SparkSQLEngine UI
- [KYUUBI #1639] Make ApiRequestContext provide KyuubiRestFrontendService directly
- [KYUUBI #1629] Flink backend implementation
- [KYUUBI #1631] Migrating existing rest fe tests to real cases
- [KYUUBI #1556] Upgrade swagger-ui version from 4.1.0 to 4.1.3
- [KYUUBI #1614] Fix hardcoded version in OpenAPIDefinition
- [KYUUBI #1623] KyuubiSessionEvent shall always have Id
- [KYUUBI #1618] Correct hadoop version in RELEASE file
- [KYUUBI #1581] Add SchemaHelper for trino engine
- [KYUUBI #1620] Implement api: /${version}/operations/${operation_identifier}/log
- [KYUUBI #1613] Record the engine’s applicationId in KyuubiSessionEvent
- [KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
- [KYUUBI #1601] Align SparkStatementEvent to KyuubiOperationEvent
- [KYUUBI #1592] [TEST][ICEBERG][DELTA] Introduce row level operation test for data lake format
- [KYUUBI #1582] Use ClientTypeSignature to further analysis of trino column type
- [KYUUBI #1607] [DOC] Add operation and backend service metrics in metrics doc
- [KYUUBI #1579] Implement basic ability of executing statement in Flink engine
- [KYUUBI #1575] Implement api: /${version}/operations/${operation_identifier}/resultsetmetadata
- [KYUUBI #1593] use user set host or ip instead of read hostname from user set
- [KYUUBI #1591] Watchdog support for Spark-3.2
- [KYUUBI #1587] [SUB-TASK][KPIP-2] Bump Flink 1.14.2
- [KYUUBI #1577] Add DropIgnoreNonexistent Rule.
- [KYUUBI #1586] Add time metric on each KyuubiBackendService method
- [KYUUBI #1578] Introduce flink-sql-client dependency to reduce some duplicated code
- [KYUUBI #1499] Introduce DataFrameHolder for cli result fetching
- [KYUUBI #1550] Provide a specific user guide about connecting to kerberized kyuubi
- [KYUUBI #1555][FLINK] Bump flink version to 1.14.0
- [KYUUBI #1554] Add kyuubi.engine.pool.name configuration
- [KYUUBI #1460] Bump Hudi 0.10.0
- [KYUUBI #1559] Bump Jersey 2.34
- [KYUUBI #1568] Replace sessionDetail with sessionEvent
- [KYUUBI #1565] Move time functions to RowSetUtils and move schema to spark package
- [KYUUBI #1567] [Bug] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
- [KYUUBI #1571] [BUILD] Correct build command in build/dist
- [KYUUBI #1558] Bump Jackson 2.12.5
- [KYUUBI #1556] Shorten kyuubi.session.engine.check.interval to one minute
- [KYUUBI #1560] Align all Jackson libs version
- [KYUUBI #1539] Replace operationDetail with KyuubiEvent
- [KYUUBI #1557] [DOC] The TTL Of Kyuubi Engines
- [KYUUBI #1174][FOLLOWUP] change configuration(ha.zookeeper.publish.configs) default value to false
- [KYUUBI #1515] Add RowSet for trino engine
- [KYUUBI #1525][FLINK] Implement GetCatalogs operation and do the further initialization
- [KYUUBI #1548] Get docs version from project.version
- [KYUUBI #1544] Update the mailing list to send announcement
- [KYUUBI #1542] Move FetchIterator into kyuubi-common for multi-engine support
- [KYUUBI #1541] Remove keys sync step for Kyuubi finalize release
- [KYUUBI #1533] Add documentation about Kyuubi docker-image-tool using Spark image as BASE_IMAGE
- [KYUUBI #1535] Remove duplicate hive client version property
- [KYUUBI #1531] Add kyuubi version in engineSpace
- [KYUUBI #1528] Record the kyuubi server ip address in event log
- [KYUUBI #1527] [DOC] Improve High Availability Guide
- [KYUUBI #1516] Implement api: /${version}/operations/${operation_identifier}
- [KYUUBI #1480] Fix bug in docker-image-tool & Provider image way to config SPARK instead of local copy
- [KYUUBI #1393][TASK-2] Add operation number metric
- [KYUUBI #1523] Refine usage about option ‘–namespace’ in kyuubi-ctl
- [KYUUBI #1522] Pass the client ip to engine
- [KYUUBI #1526] [DOC] Update kyuubi_layers.drawio to add driver layer
- [KYUUBI #1521] [BUILD] Migrate to actions/cache@v2
- [KYUUBI #1489] Support operation log for ExecuteScala
- [KYUUBI #1520] [BUILD] Switch to setup-java@v2
- [KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
- [KYUUBI #1511] Initialize kyuubi trino engine module
- [KYUUBI #1513] Added support liveness and readiness for kyuubi pod
- [KYUUBI #1501] Introduce operationsResource
- [KYUUBI #1503] Introduce FlinkThriftBinaryFrontendService to do the further initialization
- [KYUUBI #1487] Correct the KEYS link and add script to generate vote and announcement
- [KYUUBI #1496] Support tpcds benchmark
- [KYUUBI #1508] Add Kyuubi version in UI
- [KYUUBI #1504] Support to capture console out/error into interpreter output for ExecuteScala
- [KYUUBI #1505] Move ServiceNodeInfo to a separate file
- [KYUUBI #1492] Initialize kyuubi flink sql engine module
- [KYUUBI #1445] [Kyuubi #1444] Implement api: /${version}/sessions/${session_identifier}/operations/${operation_identifier}
- [KYUUBI #1490] Introduce the basic framework for running scala
- [KYUUBI #1493] Make a reasonable thread pool size for listing file statuses
- [KYUUBI #1379] Make SESSION_ENGINE_LAUNCH_ASYNC true by default
- [KYUUBI #1486] Enable delta test on Spark 3.2 with delta 1.1.0
- [KYUUBI #1484] Add a dependency describe for kyuubi on azure delta-lake doc.
- [KYUUBI #1483] Revamp KyuubiSessionImpl and KyuubiSyncThriftClient
- [KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
- [KYUUBI #1382] Sync the flink-provided profile in docs and testing suite comments
- [KYUUBI #1481] Add z-order docs
- [KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
- [KYUUBI #1478] Docker-image-tool.sh awareness of incorrectly configured SPARK_HOME
- [KYUUBI #1472] allow the engine not to self-terminate.
- [KYUUBI #1473] Exit gracefully when engine idle
- [KYUUBI #1471] Improve log if user specify the spark principal and keytab but not same with proxy user
- [KYUUBI #1446] Decouple zookeeper from abstract ServiceDiscovery
- [KYUUBI #1470] Git ignore kyuubi-server metrics
- [KYUUBI #1467] Add The Doc of Intergrate Azure Blob Storage Based Delta Lake with Kyuubi
- [KYUUBI #1469] Add cancel vote template and add release notes into vote template
- [KYUUBI #1462] [DOC] Use relative paths instead of absolute paths
- [KYUUBI #1466] Unify the guava version for kyuubi server and kyuubi beeline
- [KYUUBI #1463] Enabled to preserve symbolic links when copying dist dir
- [KYUUBI #1454] Add Doc About Deploy Kyuubi On Kubernetes
- [KYUUBI #1459] Kyuubi Server Event Test change
- [KYUUBI #1461] [DOC] Remove deprecated dist repo directory for deprecated release candidates
- [KYUUBI #1396][K8S] Add docker image tools and replace Dockerfile
- [KYUUBI #1443] MaxPartitionStrategy support file source based table.
- [KYUUBI #1050] Add KyuubiServerInfoEvent
- [KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl.
- [KYUUBI #1442] Fix encode MySQLHandshakePacket UT
- Ada Wong
- Brian Yue
- Cheng Pan
- Fei Wang
- Fu Chen
- HYBG-1126
- I521853
- Jeff Zhang
- Kent Yao
- Martin Tzvetanov Grigorov
- Muru Muthusamy
- Paul Lam
- Paul Lin
- Rishi Kumar Ray
- Simon
- SteNicholas
- Tianlin Liao
- Wang Zhen
- fwang12
- hongdongdong
- hwk42
- jiaoqingbo
- jing10.gao
- mask
- minyk
- odone
- rayliu
- senmiaoliu
- shenbing
- simon
- sundapeng
- sunfangbin
- sychen
- ulysses-you
- wForget
- xifeng yang
- yanghua
- zhenjiaguo
- zhichaoleo
- zhouyifan279
- zwangsheng
[KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
[KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
[KYUUBI #1473] Exit gracefully when engine idle
[KYUUBI #1567] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
[KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl
[KYUUBI #1806] Fix LaunchEngine may be closed multiple times
[KYUUBI #1731] Kyuubi server should not fail to start when Hadoop FileSystem class not found
[KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
[KYUUBI #1800] [1.4] Remove oom hook
[KYUUBI #1784] Fix float types lose precision
[KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
[KYUUBI #1722] [NOTICE] Update NOTICE for 2022
[KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
[KYUUBI #1225] [KYUUBI #1228] Add kyuubi-extension-spark-3-2 module and profile to support latest spark-3.2
[KYUUBI #939] Add Z-Order extensions to support optimize SQL
[KYUUBI #913] Support long running SQL engine without principal and keytab provided
[KYUUBI #1219] Support MySQL Protocol Frontend
[KYUUBI #1349] Add new conf kyuubi.frontend.protocols
[KYUUBI #1206] Support GROUP engine share level
[KYUUBI #1018] Set spark.sql.execution.topKSortFallbackThreshold to 10000
[KYUUBI #1059] Add Plan Only Operations
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #1159] Add Session stats on Kyuubi Query Engine Page
[KYUUBI #1198] Support to incremental collect statement result
[KYUUBI #1248] Change kyuubi.engine.session.initialize.sql default value to Nil
[KYUUBI #1286] Increase kyuubi.session.engine.initialize.timeout default to 3min
[KYUUBI #1323] Introduce EngineType to distinguish multiple engines
[KYUUBI #1262] Support both KERBEROS and PLAIN authentication at the same time
[KYUUBI #1160] Support to config operation log root dir both for kyuubi server and engine sides
[KYUUBI #1204] Enhance zookeeper authentication and ACLs
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #703] Integrate test with Hudi 0.9.0
[KYUUBI #1338] Integrate test with Iceberg 0.12.1
[KYUUBI #1131] Rename KyuubiDriver to KyuubiHiveDriver
[KYUUBI #1346] Support launch query engine asynchronously during opening session
[KYUUBI #1377] Support to get launch engine log asynchronously with KyuubiConnection
[KYUUBI #1414] Add kyuubi-hive-beeline module to support KyuubiConnection and KyuubiStatement
[KYUUBI #1047] Use deployment to run kyuubi server HA on K8s
[KYUUBI #1223] Remove dead module kyuubi-spark-monitor
[KYUUBI #1277] Add UDF engine_id
[KYUUBI #660] Add UDF session_user
[KYUUBI #1190] Enhance error log detection in case lost the exception log
[KYUUBI #1067] Catch exception if logRoot is not exist
[KYUUBI #884] [FOLLOWUP] Fix catalog in KyuubiDatabaseMetaData#getTables
[KYUUBI #1108] Register KyuubiDriver in ServiceLoader
[KYUUBI #1094] [BUGFIX #1068]Support upload file to HDFS
[KYUUBI #1034] Engine may deadlock when close operationLog
[KYUUBI #1057] [KYUUBI#1056] Output error log when currentEngine is None
[KYUUBI #1158] [INFRA] Update ANNOUNCE mail template
[KYUUBI #1107] [INFRA] Add release mail templates
[KYUUBI #1141] Remove redundant unit
[KYUUBI #1134] [TEST] DataLake suites should clean up withKyuubiConf instead of extraConfigs
[KYUUBI #1130] [DOCS] Restore Kyuubi logo image size
[KYUUBI #1125] [FOLLOWUP] Compress and remove duplicated new logo and keep legacy logo
[KYUUBI #1125] A new version of logo flie, apache information included.
[KYUUBI #1104] Fix release script finalize_svn
[KYUUBI #1096] Remove never expired declaration in NOTICE
[KYUUBI #1263] Kyuubi auxiliary UDF failed on Spark Yarn mode
[KYUUBI #1267] Modify comments for the golden file test suite and fix it
完全验证,支持最新的 Spark 3.0/3.1
支持在 JDK8(默认)、JDK11 上构建
在 Kyuubi Spark Extensions 中提供增强的 AQE(适用于 Spark 3.1)
提供几个辅助 SQL 函数作为 Spark 内置函数的补充
Spark on Kubernetes 的主要改进,包括文档、集成测试、工具等
支持引擎/会话级别可配置的初始化 SQL 语句
支持自定义认证实现
支持通过 Web UI 停止 Spark 引擎
支持单会话模式
可观察性的几项改进
对数据湖平台 Delta、Iceberg 进行全面测试
对 MiniYARNCluster 进行全面测试
[KYUUBI #631] Add kyuubi-spark-extensions-3-1 module
[KYUUBI #657][KYUUBI #659] Provides auxiliary SQL functions as supplement to Spark’s built-in Functions
[KYUUBI #897] Support stop Spark engine through Web UI
[KYUUBI #762] Add Kyuubi Hive JDBC Module
[KYUUBI #926] Support add repartition for OptimizedCreateHiveTableAsSelectCommand
[KYUUBI #670] KyuubiSQLException support sqlState and errorCode
[KYUUBI #707] Respect spark.sql.catalogImplementation in engine
[KYUUBI #641] Support custom authentication
[KYUUBI #751] Support single session mode
[1.2][KYUUBI #457] Support configurable initialize sql statement for engine startup
[KYUUBI #857] Support configurable initialize SQL statement for each session
[KYUUBI #755] Default build against Spark 3.1
[KYUUBI #693][KYUUBI #760] Support build against JDK11
[KYUUBI #768][K8S] Add module shuffle-files-cleaner
[KYUUBI #844][K8S] Exposing Kyuubi as a NodePort service
[KYUUBI #859][K8S] Add kubernetes configmap
[KYUUBI #656][K8S] Document how to deploy Kyuubi engines on Kubernetes
[KYUUBI #776][K8S] Run kyuubi on Kubernetes - make basic dockerfile and example
[KYUUBI #444][KYUUBI #854][TEST][K8S] Add minikube for K8s integration test
[KYUUBI #712][LDAP] Add a new config property authentication.ldap.guidKey
[KYUUBI #643][TEST] Test Detla 1.0.0 with Spark 3.1
[KYUUBI #948][TEST] Test Iceberg 0.12.0 with Spark 3.0/3.1
[KYUUBI #527][TEST][YARN] Test with MiniYARNCluster
[KYUUBI #737] Add monitor module
[KYUUBI #727] Add the listener for each SQL
[KYUUBI #767] Add statement event tracking
- [1.2][KYUUBI #629] Refine distributed lock to lock only engine bootstrap
[KYUUBI #416] Detected Dependency List Change for better dependency management
[KYUUBI #487][KYUUBI #566] Add TPC-DS DDL test cases
[KYUUBI #871] Change module name kyuubi-main to kyuubi-server
发布记录 - 1.6.0-incubating
2022 9月 6
重大更新
服务端
客户端
引擎
插件
文档
更改列表
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的:
发布记录 - 1.5.2-incubating
2022 6月 18
更改列表
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的:
发布记录 - 1.5.1-incubating
2022 4月 21
更改列表
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的:
发布记录 - 1.5.0-incubating
2022 3月 25
重大更新
更改列表
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的:
Apache Kyuubi(Incubating) 1.4.1-incubating 发布记录
2022 1月 31
大家好,
Apache Kyuubi (Incubating) 1.4.1-incubating 现已发布。它是一个维护版本,包含基于 branch-1.4 的稳定性修复。主要修复事件日志的一些问题。
Apache Kyuubi (Incubating) 是一个用于大规模数据处理和分析的分布式多租户 JDBC 服务,构建在 Apache Spark 之上,旨在支持更多引擎(如 Apache Flink)。请参考 Apache Kyuubi (Incubating) 了解更多。
要下载 Apache Kyuubi (Incubating) 1.4.1-incubating,请访问 downloads page.
重大更新
其他
致谢
感谢以下贡献者帮助审查并提交代码至 Apache Kyuubi (Incubating) 1.4.1-incubating 版本,排序以字典顺序为准:
Cheng Pan, Fei Wang, Fu Chen, Muru Muthusamy, Wang Zhen, sunfangbin, sychen, ulysses-you, yanghua, zhenjiaguo, zhouyifan279, zwangsheng
Apache Kyuubi(Incubating) 1.4.0-incubating 发布记录
2021 12月 10
大家好,
在这个版本中,Kyuubi 支持最新的 Spark 3.2,Z-Order 优化 sql 查询,无需提供 principal 和 keytab 的长时间运行的 SQL 引擎,支持 mysql 协议前端和 mysql 客户端。 其他主要更新包括 GROUP 引擎共享级别的支持、支持异步打开会话、用户友好的 kyuubi beeline 和 zookeeper 身份验证增强。
要下载 Apache Kyuubi (Incubating) 1.4.0-incubating,请访问 下载页面。
重大更新
使用最新的 Spark 3.2 进行了全面验证
支持Z-Order优化SQL
支持长时间运行的 SQL 引擎,无需提供 principal 和 keytab
支持 GROUP 引擎共享级别
增强 USER 引擎共享级别,支持引擎池
增强 zookeeper 身份验证和 ACL
添加更多 Kyuubi 自定义的函数
对所有数据湖平台 Delta Lake、Iceberg 和 Hudi 进行全面测试
同时支持 KERBEROS 和 PLAIN 认证
支持 MySQL 协议前端和 MySQL 客户端(实验性质)
支持在打开会话期间异步启动查询引擎和用户友好的 Kyuubi Hive JDBC 和 BeeLine
功能性更新
集成
Hive JDBC
其他
致谢
最后但同样重要的是,如果没有以下贡献者,该版本是不可能发布的: AnybodyHome, Brian Yue, Cheng Pan, Fei Wang, Fu Chen, Jagadesh Adireddi, Kent Yao, Min Zhao, Guoqing Yang, h, happytofly, hongdongdong, jiaoqingbo, qiuliang, qphien, senmiaoliu, simon, sunfangbin, sychen, timothy65535, ulysses-you, wFoget, xiebo03, xiongyinke, yanghua, yanyu34946, zhang1002, zhenjiaguo, zhouyifan279, zwangsheng, 张宇翔
Apache Kyuubi(Incubating) 1.3.1-incubating 发布记录
2021 10月 25
大家好,
Apache Kyuubi (Incubating) 1.3.1-incubating 现已发布。这是一个包含基于 branch-1.3 的稳定性修复的维护版本。主要修复事件日志的一些问题。
Apache Kyuubi (Incubating) 是一个用于大规模数据处理和分析的分布式多租户 JDBC 服务,构建在 Apache Spark 之上,旨在支持更多引擎(如 Apache Flink)。请参考 Apache Kyuubi (Incubating) 了解更多。
要下载 Apache Kyuubi (Incubating) 1.3.1-incubating,请访问 下载页面。
重大更新
其他
已知问题
致谢
感谢以下贡献者帮助审查并提交代码至 Apache Kyuubi (Incubating) 1.3.1-incubating 版本,以提交时间排序: qiuliang, hongdd, Yuxiang Zhang, Cheng Pan, happytofly, timothy, cxzl25, Xiduo You, Simon
Apache Kyuubi(Incubating) 1.3.0-incubating 发布记录
2021 9月 14
要下载 Apache Kyuubi (Incubating) 1.3.0-incubating,请访问 下载页面。