Releases Archive
- Support Batch(Jar) Job submission
- Support Thrift HTTP mode
- Support Etcd as Discovery Service
- Support JDBC authentication mechanism
- Unify the authentication for Thrift and REST v1 API
- Enhance metrics system
- Introduce REST client for Batch(Jar) Job submission
- Decouple Hive and Hadoop dependencies from builtin JDBC driver
- Builtin JDBC driver supports using keytab for Kerberos authentication
- Enhance beeline to support Spark console progress bar
- Fully verified with the latest Spark 3.1/3.2/3.3
- Fully verified with the latest Flink 1.14/1.15
- Fully verified with the Trino 363
- Support Hive backend Engine (Beta)
- Support JDBC backend Engine (Beta)
- Introduce Spark TPC-DS connector
- Introduce Spark TPC-H connector
- Introduce Spark Authz (Apache Ranger) plugin
- User Documentation refactoring and improvement
- [KYUUBI #3363] Kyuubi Beeline requires commons-lang
- [KYUUBI #3353] Backport HIVE-21899 - Utils.getCanonicalHostName() may return IP address depending on DNS infra
- [KYUUBI #3355] Backport HIVE-20583 - Use canonical hostname only for kerberos auth in HiveConnection
- [KYUUBI #3348] Specifies none checks to be performed on Javadoc comments for maven-javadoc-plugin
- [KYUUBI #3347] [MINOR] Relocation
AccessControlException
- [KYUUBI #3336] Use StageAttempt instead of StageId in SQLOperationListener
- [KYUUBI #3023] [FOLLOWUP] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
- [KYUUBI #3316] [BUILD] Enable spark-3.3 profile for license check on GA
- [KYUUBI #3254] Supplement the licenses of support etcd discovery
- [KYUUBI #3301] Construct lifetimeTerminatingChecker only when needed
- [KYUUBI #3272] Synchronize graceful shutdown with main stop sequence
- [KYUUBI #3281] [MINOR] Use AccessControlException instead of RuntimeException if check privilege failed
- [KYUUBI #3222] [FOLLOWUP] Fixing placeholder and config of user in JDBC Authentication Provider
- [KYUUBI #3275] [KYUUBI 3269] [DOCS] Doc for JDBC authentication provider
- [KYUUBI #3217] [DOCS] Doc for using Marcos in row-level filter in Authz
- [KYUUBI #3297] [MINOR] Null is replaced by KyuubiSQLException.featureNotSupported()
- [KYUUBI #3244] Bump Hudi 0.12.0
- [KYUUBI #3287] Exclude reload4j from hadoop-minikdc
- [KYUUBI #3222] [FOLLOWUP] Introdude JdbcUtils to simplify code
- [KYUUBI #3020] [FOLLOWUP] Refactor the code style
- [KYUUBI #3020] kyuubi ldap add new config property kyuubi.authentication.ldap.bindpw and kyuubi.authentication.ldap.attrs
- [KYUUBI #3226] Privileges should be checked only once in
RuleAuthorization
- [KYUUBI #3156] Expose REST frontend connection metrics
- [KYUUBI #3241] [DOCS] Update
Develop Tools / Building a Runnable Distribution
- [KYUUBI #3255] Add miss engine type config docs
- [KYUUBI #3214] Plan only mode should unset when mode value is incorrect
- [KYUUBI #3239] [SUBTASK] DorisSQLEngine - Add integration tests
- [KYUUBI #3252] Fix the problem that |release| in the document was not replaced correctly
- [KYUUBI #3247] Minor clean up Kyuubi JDBC code
- [KYUUBI #3222] JDBC Authentication Provider for server
- [KYUUBI #3243] Move trait Logging#initializeLogging to object Logging
- [KYUUBI #3245] Add spark-3.3 profile in building.md
- [KYUUBI #3184] OperationResource rowset api should have default values for maxrows and fetchorientation
- [KYUUBI #3220] Make kyuubi.engine.ui.stop.enabled false in HistoryServer
- [KYUUBI #1776] [FOLLOWUP] Fill empty td tag for
Failure Reason
column in EngineTable - [KYUUBI #3157] [DOC] Modify logging doc due to using log4j2 instead of log4j
- [KYUUBI #3228] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-DS
- [KYUUBI #3138] [SUBTASK] DorisSQLEngine - Add jdbc engine to dist
- [KYUUBI #3230] Flink SQL engine supports run across versions
- [KYUUBI #3072] [DOC] Add a doc of Flink Table Store for Flink SQL engine
- [KYUUBI #3170] Expose thrift binary connection metrics
- [KYUUBI #3227] SparkConfParser supports parse bytes and time
- [KYUUBI #3219] Error renew delegation tokens: Unknown version of delegation token 8
- [KYUUBI #3080] [DOC] Add a doc of the Flink Table Store for the Trino SQL Engine
- [KYUUBI #3107] [SUBTASK] DorisSQLEngine - Add process builder (#3123)
- [KYUUBI #3211] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-H
- [KYUUBI #3206] Change Flink default version to 1.15
- [KYUUBI #833] Check if
spark.kubernetes.executor.podNamePrefix
is invalid - [KYUUBI #3098] Unify the event log code path
- [KYUUBI #3210] [DOCS] Mention Kyuubi Spark SQL extension supports Spark 3.3
- [KYUUBI #3204] Fix duplicated ldapServer#close in LdapAuthenticationProviderImplSuite
- [KYUUBI #3209] Support configure TPC-H connector in runtime
- [KYUUBI #3200] Make KyuubiSessionEvent.sessionId clear
- [KYUUBI #3186] Support applying Row-level Filter and Data Masking policies for DatasourceV2 in Authz module
- [KYUUBI #2584] [INFRA] Migrate CI to Ubuntu 22.04
- [KYUUBI #3172] [FLINK] Fix failed test cases in Flink 1.15
- [KYUUBI #3203] [DOCS] Fix typo
- [KYUUBI #3192] Refactor TPCDSConf
- [KYUUBI #3180] Add component version util
- [KYUUBI #3162] Bump Hadoop 3.3.4
- [KYUUBI #3191] [DOCS] Add missing binary scala version in engine jar name
- [KYUUBI #3199] [BUILD] Fix travis JAVA_HOME
- [KYUUBI #3194] [Scala-2.13] Refine deprecated config
- [KYUUBI #3198] [DOCS] Fix index of Hudi Flink connector
- [KYUUBI #3189] [BUILD] Bump jetcd 0.7.3 and pin Netty dependencies
- [KYUUBI #3190] [BUILD] Use jdk_switcher to setup JAVA_HOME
- [KYUUBI #3145] Bump log4j from 2.17.2 to 2.18.0
- [KYUUBI #3135] Bump gRPC from 1.47.0 to 1.48.0
- [KYUUBI #3178] Add application operation docs
- [KYUUBI #3174] Update MATURITY for C30, RE50, CO20, CO40, CO50, CS10, IN10
- [KYUUBI #3175] Add session conf advisor docs
- [KYUUBI #3141] Trino engine etcd support
- [KYUUBI #3150] Expose metadata request metrics
- [KYUUBI #3070] [DOC] Add a doc of the Hudi connector for the Flink SQL Engine
- [KYUUBI #3104] Support SSL for Etcd
- [KYUUBI #3152] Introduce JDBC parameters to control connection timeout
- [KYUUBI #3136] Change Map to a case class ApplicationInfo as the application info holder
- [KYUUBI #2240] [SUBTASK] Skip add metadata manager if frontend does not support rest
- [KYUUBI #3131] Improve operation state change logging
- [KYUUBI #3158] Fix npe issue when formatting the kyuubi-ctl output
- [KYUUBI #3160] [DOCS]
Dependencies
links inConnectors for Spark SQL Query Engine
pages jump to wrong place #3160 (#3161) - [KYUUBI #3154] [SUBTASK] Connectors for Spark SQL Query Engine -> TiDB/TiKV
- [KYUUBI #3082] Add iceberg connector doc for Trino SQL Engine
- [KYUUBI #3071] [DOC] Add iceberg connector for Flink SQL Engine
- [KYUUBI #3153] Move batch util class to kyuubi rest sdk for programing friendly
- [KYUUBI #3067] [DOC] Add Flink Table Store connector doc for Spark SQL Engine
- [KYUUBI #3148] Change etcd docker image to recover arm64 CI
- [KYUUBI #3119] [TEST] Using more light-weight SparkPi for batch related tests
- [KYUUBI #3023] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
- [KYUUBI #3144] Remove deprecated KyuubiDriver in services manifest
- [KYUUBI #3143] Check class loadable before applying SLF4JBridgeHandler
- [KYUUBI #3139] Override toString method for rest dto classes
- [KYUUBI #3087] Convert the kyuubi batch conf with
spark.
prefix so that spark could identify - [KYUUBI #3133] Always run Flink statement in sync mode
- [KYUUBI #3121] [CI] Fix GA oom issue
- [KYUUBI #3126] Using markdown 3.3.7 for kyuubi document build
- [KYUUBI #3106] Correct
RelMetadataProvider
used in flink-sql-engine - [KYUUBI #3069] [DOC] Add Iceberg connector doc for Spark SQL Engine
- [KYUUBI #3068] [DOC] Add the Hudi connector doc for Spark SQL Query Engine
- [KYUUBI #3108] [DOC] Fix path errors in the build document
- [KYUUBI #3111] Replace HashMap with singletonMap
- [KYUUBI #3113] Bump up delta lake version from 2.0.0rc1 to 2.0.0
- [KYUUBI #3101] [SUBTASK][#3100] Build the content for extension points documentation
- [KYUUBI #3102] Fix multi endpoints for etcd
- [KYUUBI #3008] Bump prometheus from 0.14.1 to 0.16.0
- [KYUUBI #3095] Move TPC-DS/TPC-H queries to unique folder
- [KYUUBI #3094] Code refactor on Kyuubi Hive JDBC driver
- [KYUUBI #3092] Replace apache commons Base64 w/ JDK
- [KYUUBI #3093] Fix Kyuubi Hive JDBC driver SPNEGO header
- [KYUUBI #3050] Bump Apache Iceberg 0.14.0
- [KYUUBI #3044] Bump Spark 3.2.2
- [KYUUBI #3052] [FOLLOWUP] Do not use the ip in proxy http header for authentication to prevent CVE
- [KYUUBI #3051] Support to get the real client ip address for thrift connection when using VIP as kyuubi server load balancer
- [KYUUBI #3046] [Metrics] Add meter metrics for recording the rate of the operation state for each kyuubi operation
- [KYUUBI #3045] [FOLLOWUP] Correct the common options and add docs for kyuubi-admin command
- [KYUUBI #3076] [SUBTASK][#3039] Add the docs for rest api - Batch Resource
- [KYUUBI #3077] Remove meaningless statement override in LaunchEngine
- [KYUUBI #3018] [SUBTASK] DorisSQLEngine - GetColumns Operation
- [KYUUBI #3073] CredentialsManager should use appUser to renew credential
- [KYUUBI #3065] Support to retry the killApplicationByTag for JpsApplicationOperation
- [KYUUBI #3054] Add description of the discovery client in the conf doc
- [KYUUBI #3043] [FOLLOWUP] Restore accidentally removed public APIs of kyuubi-hive-jdbc module
- [KYUUBI #3060] [SUBTASK][#3059] Build content of the connector document section
- [KYUUBI #3045] Support to do admin rest request with kyuubi-adminctl
- [KYUUBI #3055] Expose client ip address into batch request conf
- [KYUUBI #3052] Support to get the real client ip address for http connection when using VIP as kyuubi server load balancer
- [KYUUBI #3043] Clean up Kyuubi Hive JDBC client
- [KYUUBI #3047] Fallback krb5 conf to OS if not configured
- [KYUUBI #2644] Add etcd discovery client for HA
- [KYUUBI #3040] [SUBTASK][#3039] Build the skeleton of client side documentation
- [KYUUBI #2974] [FEATURE] EOL Support for Spark 3.0
- [KYUUBI #3042] Kyuubi Hive JDBC should throw KyuubiSQLException
- [KYUUBI #3037] Handles configuring the JUL -> SLF4J bridge
- [KYUUBI #3033] [Bug] Kyuubi failed to start due to PID directory not exists
- [KYUUBI #3028] [FLINK] Bump Flink versions to 1.14.5 and 1.15.1
- [KYUUBI #2478] [FOLLOWUP] Fix bin/beeline without -u exits unexpectedly
- [KYUUBI #3025] Fix the kyuubi restful href link format issue
- [KYUUBI #3007] Bump scopt from 4.0.1 to 4.1.0
- [KYUUBI #3019] Backport HIVE-21538 - Beeline: password source though the console reader did not pass to connection param
- [KYUUBI #3017] kyuubi-ctl should print error message to right place
- [KYUUBI #3010] Bump Jetty from 9.4.41.v20210516 to 9.4.48.v20220622
- [KYUUBI #3011] Bump swagger from 2.1.11 to 2.2.1
- [KYUUBI #3009] Bump Jersey from 2.35 to 2.36
- [KYUUBI #2801] [FOLLOWUP] Also check whether the batch main resource path is in local dir allow list
- [KYUUBI #3012] Remove unused thrift request max attempts and related ut
- [KYUUBI #3005] [DOCS] Correct spelling errors and optimizations in ‘Building Kyuubi Documentation’ part
- [KYUUBI #3004] Clean up JDBC shaded client pom and license
- [KYUUBI #2895] Show final info in trino engine
- [KYUUBI #2984] Refactor TPCDS configurations using SparkConfParser
- [KYUUBI #2996] Remove Hive storage-api dependencies from Kyuubi Hive JDBC
- [KYUUBI #2997] Use spark shim set current namespace
- [KYUUBI #2994] Remove Hive common dependencies from Kyuubi Hive JDBC
- [KYUUBI #2850] [FOLLOWUP] Replace log4j2.properties by log4j2.xml
- [KYUUBI #2801] Add local dir allow list and check the application access path URI
- [KYUUBI #2953] Support to interrupt the thrift request if remote engine is broken
- [KYUUBI #2999] Fix Kyuubi Hive Beeline dependencies
- [KYUUBI #2850] [FOLLOWUP] Fix default log4j2 configuration
- [KYUUBI #2977] [BATCH] Using KyuubiApplicationManger#tagApplication help tag batch application
- [KYUUBI #2993] Fix typo in KyuubiConf and mark more config entries server only
- [KYUUBI #2987] Remove Hive shims-common and shims-0.23 dependencies from Kyuubi Hive JDBC
- [KYUUBI #2985] Prompt configuration when starting engine timeout
- [KYUUBI #2989] Remove HS2 active-passive support in Kyuubi Hive JDBC client
- [KYUUBI #2983] Remove Hive llap-client dependencies from Kyuubi Hive JDBC
- [KYUUBI #2981] Improve TPC-DS scan performance
- [KYUUBI #2917] Remove Hive service dependencies from Kyuubi Hive JDBC
- [KYUUBI #2868] [K8S] Add KubernetesApplicationOperation
- [KYUUBI #2979] Fix helm icon url
- [KYUUBI #2978] [SUBTASK][KPIP-4] If batch app status not found from cluster manager, fall back to metadata store
- [KYUUBI #2975] Code improvement in rest client
- [KYUUBI #2964] [SUBTASK][KPIP-4] Refine the batch response and render
- [KYUUBI #2976] Expose session name into kyuubi engine tab
- [KYUUBI #2850] [FOLLOWUP] Provide log4j2.xml.template in binary and use log4j2-defaults.xml
- [KYUUBI #2963] Bump Delta 2.0.0rc1
- [KYUUBI #2918] [Bug] Kyuubi integrated Ranger failed to query: table stats must be specified
- [KYUUBI #2966] Remove TProtocolVersion from SessionHandle/OperationHandle
- [KYUUBI #2972] Using stdout for the output of kyuubi-ctl
- [KYUUBI #2973] Decorate LOG in the RetryableRestClient with static final
- [KYUUBI #2962] [SUBTASK][KPIP-4] Throw exception if the metadata update count is zero
- [KYUUBI #2956] Support to config the connect/socket timeout of rest client for kyuubi-ctl
- [KYUUBI #2960] TFrontendService.SERVER_VERSION shall be HIVE_CLI_SERVICE_PROTOCOL_V11
- [KYUUBI #2957] [SUBTASK][KPIP-4] Use canonical host name for kyuubi instance
- [KYUUBI #2952] Remove OperationType from OperationHandle for simplification
- [KYUUBI #2955] BatchRequest args fix: need toString operation for different data types
- [KYUUBI #2949] Flaky test: execute statement - analysis exception
- [KYUUBI #2951] No need to extend CompositeService for MetadataManager
- [KYUUBI #2948] Remove thrift request timeout for KyuubiSyncThriftClient
- [KYUUBI #2943] [Bug][K8S] Remove Start Local Kyuubi Server For Kyuubi On K8S Test
- [KYUUBI #2924] Correct the frontend server start state
- [KYUUBI #886] [FOLLOWUP] Support to reload hadoop conf for KyuubiTHttpFrontendService
- [KYUUBI #2929] Kyuubi integrated Ranger does not support the CTAS syntax
- [KYUUBI #2935] Support spnego authentication for thrift http transport mode
- [KYUUBI #2894] Add synchronized for the ciphers of internal security accessor
- [KYUUBI #2927] Fix the thread in ScheduleThreadExecutorPool can’t be shutdown immediately
- [KYUUBI #2876] Bump Hudi 0.11.1
- [KYUUBI #2922] Clean up SparkConsoleProgressBar when SQL execution fails
- [KYUUBI #2919] Fix typo and wording for JDBCMetadataStoreConf
- [KYUUBI #2920] Fix typo for mysql metadata schema
- [KYUUBI #2890] Get the db From Sparksession When TableIdentifier’s Database Field Is Empty
- [KYUUBI #2911] [SUBTASK][KPIP-4] If the kyuubi instance unreachable, support to backfill state from resource manager and mark batch closed by remote kyuubi instance
- [KYUUBI #2912] [INFRA][DOCS] Improve release md
- [KYUUBI #2905] [DOCS] Update the number of new committers in MATURITY.md
- [KYUUBI #2745] [SUBTASK] DorisSQLEngine - GetTables Operation
- [KYUUBI #2628] [FOLLOWUP] Support waitCompletion for submit batch
- [KYUUBI #2827] [BUILD][TEST] Decouple integration tests from kyuubi-server
- [KYUUBI #2898] Bump maven-surefire-plugin 3.0.0-M7
- [KYUUBI #2628] [FOLLOWUP] Reuse the kyuubi-ctl batch commands for SubmitBatchCommand
- [KYUUBI #2897] Remove Hive metastore dependencies from Kyuubi Hive JDBC
- [KYUUBI #2782] Decouple Kyuubi Hive JDBC from Hive Serde
- [KYUUBI #2854] Add exception field in KyuubiSessionEvent
- [KYUUBI #2873] [INFRA][DOCS] Improve release template script
- [KYUUBI #2761] Flaky Test: engine.jdbc.doris.StatementSuite - test select
- [KYUUBI #2834] [SUBTASK][KPIP-4] Support to retry the metadata requests on transient issue and unblock main thread
- [KYUUBI #2543] Add
maxPartitionBytes
configuration for TPC-DS connecter - [KYUUBI #886] Add HTTP transport mode support to KYUUBI - no Kerberos support
- [KYUUBI #2628] [FOLLOWUP] Refine kyuubi-ctl batch commands
- [KYUUBI #2859] [SUBTASK][KPIP-4] Support
--conf
for kyuubi-ctl - [KYUUBI #2888] Bump Spark-3.3.0
- [KYUUBI #2708] Open engine session and renew engine credentials in the one
- [KYUUBI #2668] [FOLLOWUP] Add log4j for rest client test
- [KYUUBI #2881] [SUBTASK][KPIP-4] Rest client supports retry request if catch net exception
- [KYUUBI #2883] [Bug] java.lang.NoClassDefFoundError: org/apache/hadoop/hive/common/ValidWriteIdList in HiveDelegationTokenProvider#initialize
- [KYUUBI #2813] Bump Iceberg 0.13.2
- [KYUUBI #2628] [SUBTASK][KPIP-4] Implement kyuubi-ctl for batch job operation
- [KYUUBI #2872] Catch the exception for the iterator job when incremental collect is enabled
- [KYUUBI #2870] Fix sf0 query error in TPCH
- [KYUUBI #2861] [FOLLOWUP][GA] Daily publish snapshot with profile spark-3.3
- [KYUUBI #2865] Bump Spark 3.3.0-rc6
- [KYUUBI #2863] Unify the logic of tpch and tpcds to generate golden file
- [KYUUBI #2862] [BUILD] Release script supports Spark 3.3
- [KYUUBI #2861] [GA] Daily publish snapshot with profile spark-3.3
- [KYUUBI #2624] Support isExtended for FilteredShowTablesCommand in AuthZ module.
- [KYUUBI #2858] Support skipTests for kyuubi rest client module
- [KYUUBI #2848] Global temp view should only exist in session catalog
- [KYUUBI #2849] Close the engine alive pool gracefully
- [KYUUBI #2851] Log session name when opening/closing session
- [KYUUBI #2247] Change log4j2 properties to xml
- [KYUUBI #2704] verify TPC-DS query output
- [KYUUBI #2846] Add v1.5.2-incubating changelog
- [KYUUBI #2842] [TEST] Optimize the output of ExceptionThrowingDelegationTokenProvider in the Test
- [KYUUBI #2829] Make secret id static and remove thrift protocol from RPC handles
- [KYUUBI #2820] [FOLLOWUP] Fix duplicate SPNEGO typo
- [KYUUBI #2839] Refactor changelog
- [KYUUBI #2781] Fix KyuubiDataSource#getConnection to set user and password
- [KYUUBI #2845] [GA] Stop daily publish on branch-1.3
- [KYUUBI #2805] Add TPC-H queries verification
- [KYUUBI #2837] [BUILD] Support publish to private repo
- [KYUUBI #2820] [SUBTASK][KPIP-4] Support to redirect getLocalLog and closeBatchSession requests across kyuubi instances
- [KYUUBI #2830] Imporve Z-Order with Spark3.3
- [KYUUBI #2746] [INFRA] Improve NOTICE of binary release
- [KYUUBI #2825] [BUILD] Remove kyuubi-flink-sql-engine from kyuubi-server dependencies
- [KYUUBI #2211] [IMPROVEMENT] Add CHANGELOG.md to codebase for maintaining release notes
- [KYUUBI #2643] [FOLLOWUP] Using javax AuthenticationException instead of hadoop AuthenticationException
- [KYUUBI #2373] [SUBTASK][KPIP-4] Support to recovery batch session on Kyuubi instances restart
- [KYUUBI #2824] [TEST] Replace test tag ExtendedSQLTest by Slow
- [KYUUBI #2822] [GA] Set log level to info
- [KYUUBI #2817] Bump Spark 3.3.0-rc5
- [KYUUBI #2676] Flaky Test: SparkOperationProgressSuite: test operation progress
- [KYUUBI #2812] [SUBTASK][KPIP-4] Refine the batch info response
- [KYUUBI #2469] Support RangerDefaultAuditHandler for AuthZ module
- [KYUUBI #2807] Trino, Hive and JDBC Engine support session conf in newExecuteStatementOperation
- [KYUUBI #2814] Set JAVA_HOME in travis via javac
- [KYUUBI #2804] Add flaky test report template
- [KYUUBI #2800] [FOLLOWUP] Return CloseBatchReponse for kyuubi rest client deleteBatch
- [KYUUBI #2800] Refine batch mode code path
- [KYUUBI #2802] Retry opening the TSocket in KyuubiSyncThriftClient
- [KYUUBI #2742] Introduce admin resource for service admin - refresh frontend hadoop conf without restart
- [KYUUBI #2794] Change KyuubiRestException to extend RuntimeException
- [KYUUBI #2793] [DOCS] Add debugging engine
- [KYUUBI #2788] Add excludeDatabases for TPC-H catalogs
- [KYUUBI #2780] Refine stylecheck
- [KYUUBI #2789] Kyuubi Spark TPC-H Connector - Add tiny scale
- [KYUUBI #2765] [SUBTASK][KPIP-4] Refactor current kyuubi-ctl
- [KYUUBI #2717] [FOLLOWUP] Fix BatchRestApiSuite due to jdbc state store UPPER the batch type
- [KYUUBI #2717] [SUBTASK][KPIP-4] Introduce jdbc session state store for batch session multiple HA
- [KYUUBI #2643] [FOLLOWUP] Generate spnego auth token dynamically per request
- [KYUUBI #2741] Add kyuubi-spark-connector-common module
- [KYUUBI #2775] Add excludeDatabases for TPC-DS catalogs
- [KYUUBI #2643] [FOLLOWUP] Refine the rest sdk
- [KYUUBI #2553] Kyuubi Spark TPC-DS Connector - Add tiny scale
- [KYUUBI #2772] Kyuubi Spark TPC-H Connector - use log4j1
- [KYUUBI #2643] [SUBTASK][KPIP-4] Implement kyuubi rest sdk for batch job operation
- [KYUUBI #2763] Expected error code for invalid basic/spnego authentication should be SC_FORBIDDEN
- [KYUUBI #2768] Use the default DB passed in by session in Flink
- [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar
- [KYUUBI #2760] Add adapter layer in Kyuubi Hive JDBC module
- [KYUUBI #2751] [DOC] Replace sphinx_rtd_theme with sphinx_book_theme
- [KYUUBI #2754] [GA] Separate log archive name
- [KYUUBI #2755] [SUBTASK] DorisSQLEngine - add jdbc label
- [KYUUBI #2752] Kyuubi Spark TPC-DS Connector - configurable catalog’s name by initialize method
- [KYUUBI #2721] Implement dedicated set/get catalog/database operators
- [KYUUBI #2664] Kyuubi Spark TPC-H Connector - SupportsReportStatistics
- [KYUUBI #2471] [FOLLOWUP] Remove unexpected test-function.jar
- [KYUUBI #2743] colorfully kyuubi logo support
- [KYUUBI #2736] Upgrade Jackson 2.13.3
- [KYUUBI #2735] Test Spark 3.3.0-rc3
- [KYUUBI #2665] Kyuubi Spark TPC-H Connector - SupportsNamespaces
- [KYUUBI #2543] Add TPCDSTable generate benchmark
- [KYUUBI #2658] [SUBTASK] DorisSQLEngine with execute statement support
- [KYUUBI #2730] [WIP][KYUUBI #2238] Support Flink 1.15
- [KYUUBI #2663] Kyuubi Spark TPC-H Connector - Initial implementation
- [KYUUBI #2631] Rename high availability config key to support multi discovery client
- [KYUUBI #2733] [CI] Cross version verification for spark-3.3
- [KYUUBI #2285] trino’s result fetching method is changed to a streaming iterator mode to avoid hold data at server side
- [KYUUBI #2718] [KYUUBI#2405] Support Flink StringData Data Type
- [KYUUBI #2719] [SUBTASK][KPIP-4] Support internal rest request authentication to enable http request redirection across kyuubi instances
- [KYUUBI #2720] Fix KyuubiDatabaseMetaData#supportsCatalogs*
- [KYUUBI #2706] Spark extensions support Spark-3.3
- [KYUUBI #2714] Log4j2 layout pattern add date
- [KYUUBI #2686] [FOLLOWUP] Avoid potential flaky test
- [KYUUBI #2594] [FOLLOWUP] Fix flaky Test - support engine alive probe to fast fail on engine broken
- [KYUUBI #2701] Kyuubi Spark TPC-DS Connector - Rework SupportsReportStatistics and code refactor
- [KYUUBI #2712] Bump Spark master to 3.4.0-SNAPSHOT
- [KYUUBI #2541] Set nullable in table schema
- [KYUUBI #2709] Improve TPCDSTable display in Spark Web UI
- [KYUUBI #2619] Add profile spark-3.3
- [KYUUBI #2702] Fix TPC-DS columns name and add TPC-DS queries verification
- [KYUUBI #2348] Add it test for trino engine
- [KYUUBI #2686] Fix lock bug if engine initialization timeout
- [KYUUBI #2690] Make ProcessBuilder.commands immutable
- [KYUUBI #2696] [TEST] Stop NoopServer should not throw exception
- [KYUUBI #2700] Handle SPARK-37929 breaking change in TPCDSCatalog
- [KYUUBI #2683] Add INFO log in ServiceDiscovery.stopGracefully
- [KYUUBI #2694] EngineEvent.toString outputs application tags
- [KYUUBI #2594] Fix flaky Test - support engine alive probe to fast fail on engine broken
- [KYUUBI #2668] [FOLLOWUP] Remove unused Option because the collection is never null
- [KYUUBI #2675] Fix compatibility for spark authz with spark v3.3
- [KYUUBI #2680] Remove SwaggerScalaModelConverter after rest dto classes rewritten in Java
- [KYUUBI #2642] Fix flaky test - JpsApplicationOperation with spark local mode
- [KYUUBI #2668] [SUBTASK][KPIP-4] Rewrite the rest DTO classes in java
- [KYUUBI #2670] Delete the useless judgment in the extractURLComponents method of Utils.java
- [KYUUBI #2672] Check if the table exists
- [KYUUBI #2641] Client should not assume launch engine has completed on exception
- [KYUUBI #2666] Backport HIVE-24694 to Kyuubi Hive JDBC
- [KYUUBI #2661] [SUBTASK][KPIP-4] Rename GET /batches/$batchId/log to GET /batches/$batchId/localLog
- [KYUUBI #2650] Add FilteredShowColumnsCommand to AuthZ module
- [KYUUBI #2576] [FOLLOWUP] Bump Hudi 0.11.0
- [KYUUBI #2540] Kyuubi Spark TPC-DS Connector - SupportsNamespaces
- [KYUUBI #2655] Using the defined app keys for JpsApplicationOperation
- [KYUUBI #2640] Implement TGetInfoType CLI_ODBC_KEYWORDS
- [KYUUBI #2601] Add a config to support different service discovery client class implementation
- [KYUUBI #2471] Fix the bug of dynamically loading external packages
- [KYUUBI #2636] Refine BatchesResourceSuite
- [KYUUBI #2634] [SUBTASK][KPIP-4] Enhance the response error msg
- [KYUUBI #2616] Remove embedded mode support in Kyuubi Hive JDBC driver
- [KYUUBI #2605] Make SQLOperationListener configurable
- [KYUUBI #2474] [IMPROVEMENT] Add FilteredShowFunctionsCommand to Authz module
- [KYUUBI #2604] Hive Backend Engine - Multi tenancy support
- [KYUUBI #2576] Bump Hudi 0.11.0
- [KYUUBI #2473] [FOLLOWUP] Simplify FilteredShowNamespaceExec
- [KYUUBI #2621] Always use Hadoop shaded client
- [KYUUBI #2615] Add support HIVE_CLI_SERVICE_PROTOCOL_V11
- [KYUUBI #2473] [IMPROVEMENT] Add FilteredShowDatabasesCommand to AuthZ module
- [KYUUBI #2626] Replace literal by FetchType.LOG
- [KYUUBI #2614] Add commons-io to beeline module since jdbc upgraded to 3.1.3
- [KYUUBI #2539] [SUBTASK] Kyuubi Spark TPC-DS Connector - SupportsReportStatistics
- [KYUUBI #2591] Redact secret information from ProcBuilder log
- [KYUUBI #2542] [SUBTASK] Kyuubi Spark TPC-DS Connector - Make useAnsiStringType configurable
- [KYUUBI #2607] Introduce new module and setup testcontainers-based Kudu service for testing
- [KYUUBI #2333] Configuring Flink Engine heap memory and java opts
- [KYUUBI #2029] Hive Backend Engine - Operation Logs
- [KYUUBI #2609] Set Kyuubi server thrift client socket timeout to inf
- [KYUUBI #2560] Upgrade kyuubi-hive-jdbc hive version to 3.1.3
- [KYUUBI #2602] Bump testcontainers-scala 0.40.7
- [KYUUBI #2565] Variable substitution should work in plan only mode
- [KYUUBI #2493] [FOLLOWUP] Fix the exception that occurred when beeline rendered spark progress
- [KYUUBI #2378] Implement BatchesResource GET /batches/${batchId}/log
- [KYUUBI #2599] Bump scala-maven-plugin 4.6.1
- [KYUUBI #2493] Implement the progress of statement for spark sql engine
- [KYUUBI #2375] [FOLLOWUP] Implement BatchesResource GET /batches
- [KYUUBI #2588] Reformat kyuubi-hive-sql-engine/pom.xml
- [KYUUBI #2558] Fix warn message
- [KYUUBI #2427] [FOLLOWUP] Flaky test: deregister when meeting specified exception
- [KYUUBI #2582] Minimize Travis build and test
- [KYUUBI #2500] [FOLLOWUP] Resolve flink conf at engine side
- [KYUUBI #2571] Minimize YARN tests overhead
- [KYUUBI #2573] [KPIP-4][SUBTASK] Add a seekable buffered reader for random access operation log
- [KYUUBI #2375] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches
- [KYUUBI #2571] Release connection to prevent the engine leak
- [KYUUBI #2522] Even the process exit code is zero, also check the application state from resource manager
- [KYUUBI #2569] Change the acquisition method of flinkHome to keep it consistent with other engines
- [KYUUBI #2550] Fix swagger does not show the request/response schema issue
- [KYUUBI #2500] Command OptionParser for launching Flink Backend Engine
- [KYUUBI #2379] [SUBTASK][KPIP-4] Implement BatchesResource DELETE /batches/${batchId}
- [KYUUBI #2513] Support NULL type in trino engine and add QueryTests
- [KYUUBI #2403] [IMPROVEMENT] move addTimeoutMonitor to AbstractOperation because it was used in multiple engines
- [KYUUBI #2531] [SUBTASK] Kyuubi Spark TPC-DS Connector - Initial implementation
- [KYUUBI #2523] Flaky Test: KyuubiBatchYarnClusterSuite - open batch session
- [KYUUBI #2376] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches/${batchId}
- [KYUUBI #2547] Support jdbc url prefix jdbc:kyuubi://
- [KYUUBI #2549] Do not auth the request to load OpenApiConf
- [KYUUBI #2548] Prevent dead loop if the batch job submission process it not alive
- [KYUUBI #2533] Make Utils.parseURL public to remove unnecessary reflection
- [KYUUBI #2524] [DOCS] Update metrics.md
- [KYUUBI #2532] Avoid NPE in KyuubiHiveDriver.acceptsURL
- [KYUUBI #2478] [FOLLOWUP] Invoke getOpts method instead of Reflection
- [KYUUBI #2490] [FOLLOWUP] Fix and move set command test case
- [KYUUBI #2517] Rename ZorderSqlAstBuilder to KyuubiSparkSQLAstBuilder
- [KYUUBI #2025] [HIVE] Add a Hive on Yarn doc
- [KYUUBI #2032] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - SetClientInfo
- [KYUUBI #2490] Fix NPE in getOperationStatus
- [KYUUBI #2516] [DOCS] Add Contributor over time in README.md
- [KYUUBI #2346] [IMPROVEMENT] Simplify FlinkProcessBuilder with java executable
- [KYUUBI #2472] Support FilteredShowTablesCommand for AuthZ module
- [KYUUBI #2309] [SUBTASK][KPIP-4] Implement BatchesResource POST /batches
- [KYUUBI #2028] [FOLLOWUP] add engine stop event and fix the partition of initialized event
- [KYUUBI #2512] Fix broken link of IntelliJ IDEA Setup Guide
- [KYUUBI #2450] [FOLLOWUP] Remove opHandle from opHandleSet when exception occurs
- [KYUUBI #2510] Fix NPE when invoking YarnApplicationOperation::getApplicationInfoByTag
- [KYUUBI #2496] Prevent empty auth user when anonymous is allowed
- [KYUUBI #2498] Upgrade Delta version to 1.2.1
- [KYUUBI #2419] Release engine during closing kyuubi server session if share level is connection
- [KYUUBI #2487] Fix test command to make it runnable
- [KYUUBI #2457] Fix flaky test: engine log truncation
- [KYUUBI #2478] Backport HIVE-19018 to Kyuubi Beeline
- [KYUUBI #2020] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - TGetQueryId
- [KYUUBI #2484] Add conf to SessionEvent and display it in EngineSessionPage
- [KYUUBI #2433] HiveSQLEngine load required jars from HIVE_HADOOP_CLASSPATH
- [KYUUBI #2477] Change state early on stopping
- [KYUUBI #2451] Support isWrapperFor and unwrap
- [KYUUBI #2453] [IMPROVEMENT] checkValue of TypedConfigBuilder shall also print the config name
- [KYUUBI #2427] Flaky test: deregister when meeting specified exception
- [KYUUBI #2456] Supports managing engines of different share level in kyuubi-ctl
- [KYUUBI #1987] Support preserve user context in group/server share level
- [KYUUBI #2467] Remove close launchEngineOp
- [KYUUBI #2440] [IMPROVEMENT] spark engine event add endTime when it is stopped
- [KYUUBI #2461] Use the original host argument
- [KYUUBI #2463] Redact
kyuubi.ha.zookeeper.auth.digest
in Spark engine - [KYUUBI #2445] Implement ApplicationManager and Yarn/ JPS-local Application Operation
- [KYUUBI #1936] [FOLLOWUP] Stop updating credentials when credentials are expired
- [KYUUBI #2450] Update lastAccessTime in getStatus and add opHandle to opHandleSet before run
- [KYUUBI #2439] Using Pure Java TPC-DS generator
- [KYUUBI #2448] Log the engine id when opening Kyuubi connection
- [KYUUBI #2436] Add AlterTableRecoverPartitionsCommand for Spark Sql Authz PrivilegesBuilder
- [KYUUBI #2432] [DOCS] button “Download” is invalid
- [[KYUUBI #2429] KYUUBI #2416] Increase Test Coverage For Privileges Builder](https://github.com/apache/incubator-kyuubi/commit/14f675d2)
- [KYUUBI #2344] [IMPROVEMENT] Add Kyuubi Server on Kubernetes with Spark Cluster mode integration test
- [KYUUBI #2201] Show ExecutionId when running status on query engine page
- [KYUUBI #2424] [IMPROVEMENT] add Flink compile version and Trino client compile version to KyuubiServer Log
- [KYUUBI #2253] [IMPROVEMENT] Trino Engine - Events support
- [KYUUBI #2426] Return complete error stack trace information
- [KYUUBI #2410] [IMPROVEMENT] Fix docker-image-tool.sh example version to 1.4.0
- [KYUUBI #2351] Fix Hive Engine terminating blocked by non-daemon threads
- [KYUUBI #2422] Wrap close session with try-finally
- [KYUUBI #2420] Fix outdate .gitignore for dependency-reduced-pom.xml
- [KYUUBI #2368] [IMPROVEMENT] Command OptionParser for launching Trino Backend Engine
- [KYUUBI #2021] [FOLLOWUP] Move derby workaround to test code
- [KYUUBI #2301] Limit the maximum number of concurrent connections per user and ipaddress
- [KYUUBI #2323] Separate events to a submodule - kyuubi-event
- [KYUUBI #2289] Use unique tag to kill applications
- [KYUUBI #2021] Command OptionParser for launching Hive Backend Engine
- [KYUUBI #2414] [KYUUBI apache#2413 ] Fix InsertIntoHiveTableCommand case in PrivilegesBuilder#buildCommand()
- [KYUUBI #2406] Add Flink environments to template
- [KYUUBI #2355] Bump Delta Lake 1.2.0
- [KYUUBI #2349] [DOCS] Usage docs for kyuubi-ctl
- [KYUUBI #2381] [Test] Add Kyuubi on k8s With Spark on k8s client deploy-mode unit test
- [KYUUBI #2390] RuleEliminateMarker stays in analyze phase for data masking
- [KYUUBI #2395] [DOC] Add Documentation for Spark AuthZ Extension
- [KYUUBI #2397] Supports managing engines of different versions in kyuubi-ctl
- [KYUUBI #2402] [IMPROVEMENT] addTimeoutMonitor for trino engine when it run query async
- [KYUUBI #2360] [SUBTASK] Configuring Hive engine heap memory and java opts
- [KYUUBI #2399] Fix PrivilegesBuilder Build Wrong PrivilegeObjets When Query Without Project But With OrderBy/PartitionBy
- [KYUUBI #2308] [SUBTASK][KPIP-4] Batch job configuration ignore list and pre-defined configuration in server-side
- [KYUUBI #2369] [IMPROVEMENT] update developer.md to describe what append descriptions of new configurations to settings.md
- [KYUUBI #2391] Fix privileges builder return wrong result when there is no project but has filter/join
- [KYUUBI #2361] [IMPROVEMENT] Configuring Trino Engine heap memory and java opts
- [KYUUBI #2338] [DOCS] Upgrade sphinx dependencies for documentation build
- [KYUUBI #2385] Export JAVA_HOME. It seems TravisCI stopped doing it recently
- [KYUUBI #2353] [SUBTASK][KPIP-4] Implement BatchJobSubmission operation and basic KyuubiBatchSessionImpl
- [KYUUBI #2359] [Test] Build WithKyuubiServerOnKuberntes
- [KYUUBI #2330] [SUBTASK] Hive Backend Engine - GetTypeInfo Operation
- [KYUUBI #2257] Replace replace conf vars with strings in HiveSQLEngine
- [KYUUBI #2248] [DOCS] Add a flink on yarn kerberos doc
- [KYUUBI #1451] Support Data Column Masking
- [KYUUBI #2357] [IMPROVEMENT] Add warn log and check in class of HiveProcessBuilder
- [KYUUBI #2328] Support getting mainResource in the module target directory of KYUUBI_HOME
- [KYUUBI #2354] Fix NPE in process builder log capture thread
- [KYUUBI #2337] [DOCS] Access Kyuubi with Kyuubi JDBC Driver
- [KYUUBI #2331] Add createSession method to further abstract openSession
- [KYUUBI #2347] Output trino query id within query execute
- [KYUUBI #2345] [DOC] Hot Upgrade Kyuubi Server
- [KYUUBI #2336] Simplify TrinoProcessBuilder with java executable
- [KYUUBI #2343] [KYUUBI#2297] HiveEngineEvent toString is not pretty
- [KYUUBI #1989] Decouple curator from other modules
- [KYUUBI #2324] [SUBTASK][KPIP-4] Implement SparkBatchProcessBuilder to submit spark batch job
- [KYUUBI #2329] [KYUUBI#2214][FOLLOWUP] Cleanup kubernetes-deployment-it
- [KYUUBI #2216] [Test] [K8s] Add Spark Cluster mode on Kubernetes integration test
- [KYUUBI #2024] [FOLLOWUP] Hive Backend Engine - ProcBuilder for HiveEngine
- [KYUUBI #2281] The RenewDelegationToken method of TFrontendService should return SUCCESS_STATUS by default
- [KYUUBI #2300] Add http UGIAssuming handler wrapper for kerberos enabled restful frontend service
- [KYUUBI #2292] [FOLLOWUP] Unify kyuubi server plugin location
- [KYUUBI #2320] Make the CodeSource location correctly obtained on Windows
- [KYUUBI #2316] [DOCS] Fix typo in GitHub issue template
- [KYUUBI #2317] [BUILD] Bump hive-service-rpc 3.1.3 version
- [KYUUBI #2311] Refine github label
- [KYUUBI #2310] Make ranger extension work with mac m1
- [KYUUBI #2312] Spark data type TimestampNTZ supported version changes as 3.4.0
- [KYUUBI #2296] Fix operation log file handler leak
- [KYUUBI #2250] Support to limit the spark engine max running time
- [KYUUBI #2299] Fix flaky test: support engine alive probe to fast fail on engine broken
- [KYUUBI #2292] Unify kyuubi server plugin location
- [KYUUBI #2292] Unify spark extension location
- [KYUUBI #2084] [FOLLOWUP] Support arbitrary parameters for KyuubiConf
- [KYUUBI #2287] Revamp Flink IT by random port and merge tests
- [KYUUBI #1451] Add Row-level filtering support
- [KYUUBI #2280] [INFRA] Replace BSD 3-clause with ASF License v2 for scala binaries
- [KYUUBI #2277] Inline kyuubi prefix in KyuubiConf
- [KYUUBI #2266] The default value of frontend.connection.url.use.hostname should be set to true to be consistent with previous versions
- [KYUUBI #2260] The running query will not update the duration of the page
- [KYUUBI #2272] Fix incorrect doc link
- [KYUUBI #2268] Flaky test: submit spark app timeout with last log output
- [KYUUBI #2275] [DOCS] Fix missing prefix in trino engine quick start
- [KYUUBI #2243] [DOCS] Add quick start for trino engine
- [KYUUBI #2255] The engine state of Spark’s EngineEvent is hardcoded with 0
- [KYUUBI #2263] [KYUUBI #2262]Kyuubi Spark Nightly failed - select timestamp_ntz *** FAILED ***
- [KYUUBI #2209] Add detail usage documents of Flink engine
- [KYUUBI #2246] [BUILD] Pick Commons-Logging dependence out of Hudi-Common
- [KYUUBI #2028] Hive Backend Engine - Events support
- [KYUUBI #2207] Fix DayTimeIntervalType/YearMonthIntervalType Column Size
- [KYUUBI #1451] Introduce Kyuubi Spark AuthZ Module with column-level fine-grained authorization
- [KYUUBI #1798] Add EventBus module to unify the distribution and subscription of Kyuubi’s events
- [KYUUBI #2207] Support newly added spark data types: TimestampNTZType
- [KYUUBI #1021] Expire CredentialsRef in a proper time to reduce memor…
- [KYUUBI #2241] Remove unused deployment documents of Spark
- [KYUUBI #2244] load-kyuubi-env.sh should print SPARK_ENGINE_HOME for consistent
- [KYUUBI #2023] Hive Backend Engine - Shade HiveSQLEngine runtime
- [KYUUBI #1498] Support operation log for ExecuteScala
- [KYUUBI #2087] Add issue template for documentation improvement
- [KYUUBI #1962] Add timeout check for createSpark
- [KYUUBI #2218] Fix maven options about hive-provided
- [KYUUBI #2225] Support to set result max rows for spark engine
- [KYUUBI #2008] [FOLLOWUP] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2231] Close action and default sparksession before
createSpark
. - [KYUUBI #2222] Refactor the log when failing to get hadoop fs delegation token
- [KYUUBI #2227] Fix operation log dir not deleted issue
- [KYUUBI #2223] Return the last rows of log for prompts even exception detected
- [KYUUBI #2221] Shade hive-service-rpc and thrift in Spark engine
- [KYUUBI #2102] Support to retry the internal thrift request call and add engine liveness probe to enable fast fail before retry
- [KYUUBI #2207] Support newly added spark data types: DayTimeIntervalType/YearMonthIntervalType
- [KYUUBI #2085] [FOLLOWUP] Fix kyuubi-common wrong label
- [KYUUBI #2208] Fixed session close operator log session dir not deleted
- [KYUUBI #2214] Add Spark Engine on Kubernetes integration test
- [KYUUBI #2203] [FLINK] Support flink conf set by kyuubi conf file
- [KYUUBI #2197] [BUILD] Bump jersey 2.35 version
- [KYUUBI #2204] Make comments consistent with code in EngineRef
- [KYUUBI #2186] Manage test failures with kyuubi spark nightly build - execute statement - select interval
- [KYUUBI #2195] Using while-loop or for-loop instead of map/range to improve performance in RowSet
- [KYUUBI #2033] Hive Backend Engine - GetCrossReference
- [KYUUBI #2135] Build and test all modules on Linux ARM64
- [KYUUBI #2035] Hive Backend Engine -
build/dist
support - [KYUUBI #2189] Manage test failures with kyuubi spark nightly build - deregister when meeting specified exception *** FAILED ***
- [KYUUBI #2119] [FOLLOWUP] Support output progress bar in Spark engine
- [KYUUBI #2187] Manage test failures with kyuubi spark nightly build - execute simple scala code *** FAILED ***
- [KYUUBI #2184] Manage test failures with kyuubi spark nightly build - operation listener *** FAILED ***
- [KYUUBI #2034] Hive Backend Engine - GetPrimaryKeys
- [KYUUBI #2163] [K8s] copy beeline-jars into docker image
- [KYUUBI #2175] Improve CI with cancel & concurrency & paths filter
- [KYUUBI #2172] [BUILD] Bump Flink 1.14.4 version
- [KYUUBI #2159] [FLINK] Prevent loss of exception message line separator
- [KYUUBI #2024] Hive Backend Engine - ProcBuilder for HiveEngine
- [KYUUBI #2017] Hive Backend Engine - GetColumns Operation
- [KYUUBI #2019] Hive Backend Engine - GetTableTypes Operation
- [KYUUBI #2018] Hive Backend Engine - GetFunctions Operation
- [KYUUBI #2156] [FOLLOWUP] Fix configuration format in document
- [KYUUBI #2119] Support output progress bar in Spark engine
- [KYUUBI #2016] Hive Backend Engine - GetTables Operation
- [KYUUBI #2156] Change log to reflect exactly why getting token failed
- [KYUUBI #2148] [DOCS] Add dev/reformat usage
- [KYUUBI #2150] [DOCS] Fix Getting Started With Kyuubi on Kubernetes
- [KYUUBI #2143] [KYUBBI #2142][DOCS] Add IDEA setup guide
- [KYUUBI #2015] Hive Backend Engine - GetSchemas Operation
- [KYUUBI #1936] [FOLLOWUP] Send credentials when opening session and wait for completion
- [KYUUBI #2085] [FOLLOWUP] Fix the wrong path of
module:hive
- [KYUUBI #2134] Respect Spark bundled log4j in extension modules
- [KYUUBI #2014] Hive Backend Engine - GetCatalog Operation
- [KYUUBI #2129] FlinkEngine throws UnsupportedOperationException in GetColumns
- [KYUUBI #2022] Hive Backend Engine - maven-google-downloader plugin support for hive distribution
- [KYUUBI #2084] Support arbitrary parameters for KyuubiConf
- [KYUUBI #2112] Improve the compatibility of queryTimeout in more version clients
- [KYUUBI #2115] Update license and enhance collect_licenses script
- [KYUUBI #2085] Add a labeler github action to triage PRs
- [KYUUBI #1866] [FOLLOWUP] Add Deploy Kyuubi Flink engine on Yarn
- [KYUUBI #2120] Optimize RenewDelegationToken logs in Spark engine
- [KYUUBI #2104] Kill yarn job using yarn client API when kyuubi engine …
- [KYUUBI #2118] [SUBTASK][KPIP-2] Support session jars management
- [KYUUBI #2127] avoid to set HA_ZK_NAMESPACE and HA_ZK_ENGINE_REF_ID repetitively when create flink sql engine
- [KYUUBI #2123] Output engine information after openEngineSession call fails
- [KYUUBI #2125] closeSession should avoid sending RPC after openSession fails
- [KYUUBI #2116] move toString() to ProcBuilder trait from its implements
- [KYUUBI #1866] [FOLLOWUP] Add logging of Flink SQL Engine
- [KYUUBI #1866] [DOCS] Add flink sql engine quick start
- [KYUUBI #2108] Add description about trino in the config of engine.type
- [KYUUBI #2071] Using while-loop instead of map/range to improve performance in RowSet
- [KYUUBI #2070] [FLINK] Support Flink job submission on yarn-session mode
- [KYUUBI #2089] Add debugging instructions for Flink engine
- [KYUUBI #2097] [CI] Upload Test Log for CI failure shall contain trino engine log #2094
- [KYUUBI #2095] Remove useless logic about add conf when create a new engine
- [KYUUBI #1948] [FOLLOWUP] Relocate fb303 classes
- [KYUUBI #1978] Support NEGOTIATE/BASIC authorization for restful frontend service
- [KYUUBI #2081] YARN_CONF_DIR shall be added to kyuubi server classpath as HADOOP_CONF_DIR
- [KYUUBI #2078]
logCaptureThread
does not catch sparksubmit exception - [KYUUBI #1936] Send credentials when opening session and wait for completion
- [KYUUBI #2079] Update kyuubi layer source file to add flink and trino…
- [KYUUBI #1563] Fix broken link and add new link in
CONTRIBUTION.md
- [KYUUBI #2072] Improve rest server behavior
- [KYUUBI #2075] Using thread-safe FastDateFormat instead of SimpleDateFormat
- [KYUUBI #2066] Fix spelling mistake and appropriate naming
- [KYUUBI #2063] Fix engine idle timeout lose efficacy for Flink Engine
- [KYUUBI #2061] Implementation of the very basic UI on current Jetty server
- [KYUUBI #2011] Introduce to very basic hive engine
- [KYUUBI #1215] [DOC] Document incremental collection
- [KYUUBI #2043] Upgrade log4j/2.x/ to 2.17.2
- [KYUUBI #2060] Clear job group for init SQL
- [KYUUBI #2044] Remove authentication thread local objects to prevent memory leak
- [KYUUBI #1955] Add CI for branch-1.5 & 1.4 SNAPSHOTS
- [KYUUBI #2054] [KYUUBI-1819] Support closing Flink SQL engine process
- [KYUUBI #2055] correct the log service name
- [KYUUBI #2047] Support more MySQL JDBC driver versions
- Ada Wong
- BoYang
- Brandon Grams
- Cheng Pan
- Deng An
- Fei Wang
- Fu Chen
- Kent Yao
- Luning Wang
- Mahmoud Bahaa
- Martin Tzvetanov Grigorov
- Min Zhao
- Nick Song
- ParisaTork
- Paul Lin
- Shengkai Fang
- Nicholas Jiang
- Tianlin Liao
- Wang Zhen
- Xiao Zhao
- benjobs
- gabrywu
- guanhua.lgh
- hongdongdong
- jason
- jiadongdong
- jiaoqingbo
- liangbowen
- liaoyt
- liuzy04
- lxorc
- maming
- odone
- packyan
- pengqli
- senmiaoliu
- sychen
- taokelu
- Xiduo You
- wangjunbo
- Zhen Wang
- winfys
- xsun4
- Vino Yang
- yangrong688
- yikf
- zhangliang
- zhangrenhua
- zhanqian
- zhouyifan279
- zwangsheng
- [KYUUBI #2841] [1.5] Revert “[KYUUBI #2211] [Improvement] Add CHANGELOG.md to codebase for maintaining release notes”
- [KYUUBI #2746][INFRA][1.5] Improve NOTICE of binary release
- [KYUUBI-2422] Wrap close session with try-finally (#2836)
- [KYUUBI #2227] Fix operation log dir not deleted issue
- [KYUUBI #2208] Fixed session close operator log session dir not deleted
- [KYUUBI #2211] [Improvement] Add CHANGELOG.md to codebase for maintaining release notes
- [KYUUBI #2736] Upgrade Jackson 2.13.3
- [KYUUBI #2720] Fix KyuubiDatabaseMetaData#supportsCatalogs*
- [KYUUBI #2686][1.5] Fix lock bug if engine initialization timeout
- [KYUUBI #2640] Implement TGetInfoType CLI_ODBC_KEYWORDS
- [KYUUBI #2450][FOLLOWUP] Remove opHandle from opHandleSet when exception occurs
- [KYUUBI #2478] Backport HIVE-19018 to Kyuubi Beeline
- [KYUUBI #2484] Add conf to SessionEvent and display it in EngineSessionPage
- [KYUUBI #2450] Update lastAccessTime in getStatus and add opHandle to opHandleSet before run
- Cheng Pan
- Fei Wang
- jiaoqingbo
- winfys
- Xiduo You
- yangrong688
- Zhen Wang
- [KYUUBI #2354] Fix NPE in process builder log capture thread
- [KYUUBI #2296] Fix operation log file handler leak
- [KYUUBI #2266] The default value of frontend.connection.url.use.hostname should be set to true to be consistent with previous versions
- [KYUUBI #2255]The engine state of Spark’s EngineEvent is hardcoded with 0
- [KYUUBI #2008][FOLLOWUP] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2156][FOLLOWUP] Fix configuration format in document
- [KYUUBI #2156] Change log to reflect exactly why getting token failed
- [KYUUBI #2134] Respect Spark bundled log4j in extension modules
- [KYUUBI #2150] [DOCS] Fix Getting Started With Kyuubi on Kubernetes
- Cheng Pan
- Fei Wang
- HYBG
- Nick-0723
- cxzl25
- jiaoqingbo
- ulysses
- Support Flink SQL Engine (Beta)
- Support Trino/ Presto engine (Beta)
- Support Running Scala for Spark SQL Engine
- Upgrade Hive Service RPC Protocol to 3.1.2
- Engine Launch Process Switch to Async by default
- Add Session Conf Provider as Developer API
- Correctness - Fix float precision loss for Spark SQL
- Migrate from log4j1 to log4j2
- [KYUUBI #1936][FOLLOWUP] Send credentials when opening session and wait for completion
- [KYUUBI #2115][1.5] Update license and enhance collect_licenses script
- [KYUUBI #2125] closeSession should avoid sending RPC after openSession fails
- [KYUUBI #2103] [1.5] Revert “[KYUUBI #1948] Upgrade thrift version to 0.16.0”
- [KYUUBI #1866][FOLLOWUP] Add logging of Flink SQL Engine
- [KYUUBI #1866][DOCS] Add flink sql engine quick start
- [KYUUBI #2070][FLINK] Support Flink job submission on yarn-session mode
- [KYUUBI #2089] Add debugging instructions for Flink engine
- [KYUUBI #1948][FOLLOWUP] Relocate fb303 classes
- [KYUUBI #2078]
logCaptureThread
does not catch sparksubmit exception - [KYUUBI #1936] Send credentials when opening session and wait for completion
- [KYUUBI #2079] Update kyuubi layer source file to add flink and trino…
- [KYUUBI #2075] Using thread-safe FastDateFormat instead of SimpleDateFormat
- [KYUUBI #2063] Fix engine idle timeout lose efficacy for Flink Engine
- [KYUUBI #1215][DOC] Document incremental collection
- [KYUUBI #2043] Upgrade log4j/2.x/ to 2.17.2
- [KYUUBI #2060] Clear job group for init SQL
- [KYUUBI #2054] [KYUUBI-1819] Support closing Flink SQL engine process
- [KYUUBI #2055] correct the log service name
- [KYUUBI #2047] Support more MySQL JDBC driver versions
- [KYUUBI #2012] rename EventLoggingService and creates an correct directory
- [KYUUBI #2042] [KYUUI #2036] Redirect Issues/PR Notifications to notifications@kyuubi.apache.org
- [KYUUBI #2039] Remove LegacyFlinkOperationSuite
- [KYUUBI #1961] Upgrade
hive-service-rpc
to 3.1.2 - [KYUUBI #2008] Support engine type and subdomain in kyuubi-ctl
- [KYUUBI #2006] Improve the readability of ServiceControl list/get operations
- [KYUUBI #1999] Update quick_start_with_helm.md
- [KYUUBI #2000][DEPS] Bump Hadoop 3.3.2
- [KYUUBI #2004] Sync contents for CONTRIBUTING & COMMUNITY between web and main repo
- [KYUUBI #1996] Clean up log4j2 conf and enhance surefire plugin conf
- [KYUUBI #1986] Apache Kyuubi(Incubating) Maturity Self Assessment
- [KYUUBI #1988] Tune initialization of vars depend on system level confs
- [KYUUBI #1992] Remove SPARK_HOME predication.
- [KYUUBI #1960] Skip creating sparksession and starting engine if the max initialization time exceeds
- [KYUUBI #1958] Fix flaky test: statement redact for engine tab
- [[KYUUBI #1983] [KYUUBI #1806][FOLLOWUP] Fix LaunchEngine may be closed multiple times
- [KYUUBI #1981] Remove unused artifacts for common and parent module
- [KYUUBI #1972] Fix flaky test: SchedulerPoolSuite: Scheduler pool
- [KYUUBI #1969] Fix race on some service during start and stop phase
- [KYUUBI #1979] Simplify Kyuubi Event
- [KYUUBI #1975] [BUILD] Run TPC-DS test using the default Spark version
- [KYUUBI #1974] Support merge small files in multi insert statement
- [KYUUBI #1963] Make plan only mode skippable for configuable plans
- [KYUUBI #1970] Replace mirror-cn profile with Apache officially suggested dlcdn
- [KYUUBI #1948][FOLLOWUP] Remove TFramedTransport in extension-spark-3-1 and extension-spark-3-2
- [KYUUBI #1965] [DOCS] Use the newly added official logo at asf svn in README
- [KYUUBI #1948] Upgrade thrift version to 0.16.0
- [KYUUBI #1964] [BUILD] Update scalatest.exclude.tags
- [KYUUBI #1883] Support max result rows for Flink queries
- [KYUUBI #1920] Skip the Plan parsing of UseStatement
- [KYUUBI #1944] Upgrade Spark 3.1.3
- [KYUUBI #1957] Skip html comments in merge commit test body from PR desc
- [KYUUBI #1947] Revamp Github Action settings for CI
- [KYUUBI #1950] Remove ambiguous SPARK_HADOOP_VERSION
- [KYUUBI #1949] [INFA] Add homepage for every module in maven central
- [KYUUBI #1946] Close the kyuubi connection on launch engine operation failure
- [KYUUBI #1918] Build and test on Linux ARM64
- [KYUUBI #1945] [BUILD] Remove spark-hadoop from matrix to simplify workflow
- [KYUUBI #1940] [TEST] Fix EngineSecurityAccessorSuite
- [KYUUBI #1876][FOLLOWUP] Update iceberg.name
- [KYUUBI #1937] Build: Use Spark 3.2 for cross version verification
- [KYUUBI #1939] Build: Bump Jacoco maven plugin 0.8.7
- [KYUUBI #1796] Destroy the process after the engine starts
- [KYUUBI #1931]
AbstractSession._lastIdleTime
should be reset in acquire method - [KYUUBI #1919] Add more enum values for
OperationModes
- [KYUUBI #1930] Export TRINO_ENGINE_HOME in load-kyuubi-env script
- [KYUUBI #1926] Remove useless constants in Constants
- [KYUUBI #1923] Add GetFunctions for trino engine
- [KYUUBI #1906] Add GetColumns for trino engine
- [KYUUBI #1914] Update metric doc
- [KYUUBI #1867] Support
PlanOnlyStatement
operation like Spark SQL engine - [KYUUBI #1911] Add GetTypeInfo for trino engine
- [KYUUBI #1876] Set Spark 3.2.1 as default
- [KYUUBI #1536] Add session conf advisor
- [KYUUBI #1899] Bump Iceberg 0.13.1
- [KYUUBI #1887] Add GetTables for trino engine
- [KYUUBI #1909] [DOCS] Remove unnecessary docs link in readme
- [KYUUBI #1886] Add GetSchemas for trino engine
- [KYUUBI #1905] log4j2-defaults.properties is not working since log4j 2 is always intialized by default
- [KYUUBI #1908] Codecov for flink/trino/beeline/jdbc modules
- [KYUUBI #1903] Add GetTableTypes for trino engine
- [KYUUBI #1901] [GA] Fix checkout version
- [KYUUBI #1898] Enhance release guide add more information about how to…
- [KYUUBI #1896] Make
Query Details
andFailure Reason
sortable on the Kyuubi Query Engine page - [KYUUBI #1811] TPC-DS benchmark expose cli args breakdown and results-dir
- [KYUUBI #1893] Bump Delta 1.0.1
- [KYUUBI #1880] Fixed: forcedMaxOutputRows extension for join
- [KYUUBI #1889] Improve the user experience of the configuration parameters of the document
- [KYUUBI #1885] Add GetCatalogs for trino engine
- [KYUUBI #1821] Add trino ExecuteStatement
- [KYUUBI #1884] Fix compile SQL measurement
- [KYUUBI #1816] Implement KyuubiHistoryServerPlugin
- [KYUUBI #1873] Fix incorrect applicationId
- [KYUUBI #1878] Fix typo in log4j2-test.properties
- [KYUUBI #1838] Clean up query results after query operations finish
- [KYUUBI #1868] Upgrate netty from 4.1.68 to 4.1.73
- [KYUUBI #1872] Make ProcBuilder decouple with YARN
- [KYUUBI #1875] Upgrade codahale.metrics.version to 4.2.8 and its deps
- [KYUUBI #1870] Upgrate k8s client from 5.5.0 to 5.12.1
- [KYUUBI #1871] Upgrade minikube action from 2.4.2 to 2.4.3
- [KYUUBI #1804][FOLLOWUP][GA] Avoid push docker image for forked repos
- [KYUUBI #1844] Add step for generating release notes
- [KYUUBI #1849] Bump Iceberg 0.13.0 and enable Iceberg test with Spark 3.2
- [KYUUBI #1861] Migrate bind-api and activation-api from javax to jakarta
- [KYUUBI #1848] Bump Spark 3.2.1
- [KYUUBI #1769][FOLLOWUP] Exclude log4j 12 deps from spark-hive and fix detect deps change workflow
- [KYUUBI #1769][FOLLOWUP] Revert the dependency change for kyuubi-hive-jdbc(shaded) modules
- [KYUUBI #1846] Add
improvement
issue template - [KYUUBI #1858] Rename test log4j2 properties to log4j2-test.properties
- [KYUUBI #1850] Bump Prometheus 0.14.1
- [KYUUBI #1855] Suppress logging to console in scalatest
- [KYUUBI #1847] Bump Flink 1.14.3
- [KYUUBI #1829] Support executing statement async for Flink SQL engine
- [KYUUBI #1852] Fix UT property of log4j2 conf
- [KYUUBI #1769][FOLLOWUP] Some cleanups for log4j properties
- [KYUUBI #1839] Minor refactor OperationUtil
- [KYUUBI #1813] Enable the internal secure authentication between Kyuubi server and engine
- [KYUUBI #1769] [BUILD] Migrate from log4j1 to log4j2
- [KYUUBI #1832] Fixed: forcedMaxOutputRows extension for subquery
- [KYUUBI #1836] [RELEASE] Enhance release guide
- [KYUUBI #1840] Minor fix for general_incubator_vote script
- [KYUUBI #1834] [BUILD] Add support of external mvn with default mvn jvm opts when making distribution
- [KYUUBI #1835] Fix error to helm manifest
- [KYUUBI #1786] Fix the Spark sql engine logger level changed to WARN issue
- [KYUUBI #1685] Support jar and lib start option
- [KYUUBI #1778] Support Flink Set/Reset Operations
- [KYUUBI #1825] Generate appName for Flink applications
- [KYUUBI #1831] [DOCS] Fix the jdbc connection url format doc
- [KYUUBI #1610] Rest frontend service jetty server has started at null
- [KYUUBI #1806] Fix LaunchEngine may be closed multiple times
- [KYUUBI #1698] Add kyuubi server operation state rate
- [KYUUBI #1808] Update the link in the PULL_REQUEST_TEMPLATE
- [KYUUBI #1800] Remove oom hook
- [KYUUBI #1780] Log error message on REST endpoints
- [KYUUBI #1784][FOLLOWUP][TRINO] Fix float types lose precision
- [KYUUBI #1784][FOLLOWUP][FLINK] Support float type
- [KYUUBI #1797] Only exposing jdbc url for server side
- [KYUUBI #1804]Avoid nightly build for forked repos
- [KYUUBI #1764] Reuse the workingDir in ProcBuilder
- [KYUUBI #1699] Improve codahale metric
- [KYUUBI #1784] Fix float types lose precision
- [KYUUBI #1787] Export FLINK_ENGINE_HOME in load-kyuubi-env script
- [KYUUBI #1774] Export FLINK_HOME in load-kyuubi-env script
- [KYUUBI #1775] Add kyuubi.server.name configuration
- [KYUUBI #1785] Stop Discovery services properly
- [KYUUBI #1643][FOLLOWUP] Fix Flink GetFunctions result schema
- [KYUUBI #1788] Update greetings.yml
- [KYUUBI #1776] Improve EnginePage
- [KYUUBI #1648] Implement Flink GetTypeInfo operation
- [KYUUBI #1771] Change rate unit in
JsonReporterService
- [KYUUBI #1696] Add fetch logs and results rows rate
- [KYUUBI #1704] Complete Flink-Hive data type mapping
- [KYUUBI #1645] Implement Flink engine GetSchemas operation
- [KYUUBI #1714] Add executeScala api for KyuubiStatement
- [KYUUBI #1756] Clean up code of FlinkOperation
- [KYUUBI #1766] [TEST] Remove SessionManagerSuite to reduce duplicated tests
- [KYUUBI #1763] [INFRA] Remove scala installation in
build/mvn
and using warn level for the ci - [KYUUBI #1643] Implement GetFunctions operation
- [KYUUBI #1761] [SubTask][THTTP] Make abstract TFrontendService for thrift http protocol support
- [KYUUBI #1757] Extract workingDir from engine specific process builde…
- [KYUUBI #1510] Add TRINO engine type and TrinoProcessBuilder
- [KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
- [KYUUBI #1759] Remove duplicate close operation api
- [KYUUBI #1731][FEATURE][FOLLOWUP] Use validated HadoopFs URI in HadoopFsDelegationTokenProvider#obtainDelegationTokens
- [KYUUBI #1738] Unify kubernetes integration test
- [KYUUBI #1660] Add restart option for bin/kyuubi
- [KYUUBI #1746] Move sparkEngineMajorMinorVersion into SparkQueryTests to make HiveJDBCTestHelper spark free
- [KYUUBI #1743] Fix parallelism of DataGenerator and other enhancements
- [KYUUBI #1740] Use testcontainers scalatest in trino module
- [KYUUBI #1745] [KYUBBI #1744] Fix trino client flaky test
- [KYUUBI #1737] [WIP][KYUUBI #1731][FEATURE] Kyuubi server should not fail to start when Hadoop FileSystem class not found
- [KYUUBI #1716] Unify Hive deps for server and client
- [KYUUBI #1729] Extract java lint workflow to a single yml and disable it in other jobs
- [KYUUBI #1735] [CI] Add current ip address, long hostname and short hostname to /etc/hosts
- [KYUUBI #1736] Bump up GA actions/checkout to latest (v2.3.5)
- [KYUUBI #1732] Reduce spark driver memory configuration to protect fa…
- [KYUUBI #1730] Use getHostName instead of getCanonicalHostName
- [KYUUBI #1672] Add VersionInfo in REST API
- [KYUUBI #1726] Extract dep workflow to a single yml and disable it in other jobs
- [KYUUBI #1719] javax.activation:activation:jar duplicates
- [KYUUBI #1720] Extract scalastyle workflow to a single yml and disable it in other jobs
- [KYUUBI #1646] support flink get tables
- [KYUUBI #1723] Create greetings.yml
- [KYUUBI #1722] [NOTICE] Update NOTICE for 2022
- [KYUUBI #1721] Recover maven deplop plugin in all module
- [KYUUBI #1709] Introduce a IT module for Kyuubi and FlinkSQL Engine t…
- [KYUUBI #1718] Extract rat workflow to a single yml and disable it in other jobs
- [KYUUBI #1717] Extract rat configurations from pom to file
- [KYUUBI #1715] For kyuubi-beeline, using kyuubi-hive-jdbc instead of kyuubi-hive-jdbc-shaded
- [KYUUBI #1712] Bump up maven.version to 3.8.4
- [KYUUBI #1710] Support to specify OPERATION_LANGUAGE with TExecuteStatementReq confOverlay
- [KYUUBI #1647] Change GetCatalog returned schema key name to support JDBC specification
- [KYUUBI #1690] Checking whether launchEngineOpHandle is null for KyuubiConnection:: getExecLog
- [KYUUBI #1697] BackendService method avg call times and rate
- [KYUUBI #1681] Extend Flink ExecuteStatement to support more operations
- [KYUUBI #1705] Support decimal type for Flink SQL Engine
- [KYUUBI #1691] Implement api: /${version}/operations/${operation_identifier}/rowset
- [KYUUBI #1641] Add Trino client
- [KYUUBI #1647] Implement GetTableTypes operation
- [KYUUBI #1477] Use KyuubiHadoopUtils.newHadoopConf instead of new Con…
- [KYUUBI #1678] Fixed: The value of hasResultSet is always set to true in Kyuubi Server
- [KYUUBI #1679] Remove invalid column and field number check
- [KYUUBI #1673] [BUILD] Improve log4j configurations
- [KYUUBI #1568] [FOLLOWUP] Add getSessionEvent in session
- [KYUUBI #1675][FEATURE] Redact secret information from SparkSQLEngine log
- [KYUUBI #1674] Uncache cached tables when session closed
- [KYUUBI #1654][Bug] Flaky OperationsResourceSuite
- [KYUUBI #1665][FOLLOWUP] Rename FlinkEngineProcessBuilder to FlinkProcessBuilder to align with SparkProcessBuilder
- [KYUUBI #1594] SparkProcessBuild submit add –conf spark.driver.host=
- [KYUUBI #1665] Rename FlinkEngineProcessBuilder to FlinkProcessBuilder to align with SparkProcessBuilder
- [KYUUBI #1656] Fix dist failed with –spark-provided
- [KYUUBI #1658] Revamp swagger ui dependencies
- [KYUUBI #1662] Turn up maven options in mvn script
- [KYUUBI #1597] fix row value in Query Execution should be queryExecution
- [KYUUBI #1649] Determine the yarn command in stop-application.sh.
- [KYUUBI #1634][FEATURE] Redact secret information from SparkSQLEngine UI
- [KYUUBI #1639] Make ApiRequestContext provide KyuubiRestFrontendService directly
- [KYUUBI #1629] Flink backend implementation
- [KYUUBI #1631] Migrating existing rest fe tests to real cases
- [KYUUBI #1556] Upgrade swagger-ui version from 4.1.0 to 4.1.3
- [KYUUBI #1614] Fix hardcoded version in OpenAPIDefinition
- [KYUUBI #1623] KyuubiSessionEvent shall always have Id
- [KYUUBI #1618] Correct hadoop version in RELEASE file
- [KYUUBI #1581] Add SchemaHelper for trino engine
- [KYUUBI #1620] Implement api: /${version}/operations/${operation_identifier}/log
- [KYUUBI #1613] Record the engine’s applicationId in KyuubiSessionEvent
- [KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
- [KYUUBI #1601] Align SparkStatementEvent to KyuubiOperationEvent
- [KYUUBI #1592] [TEST][ICEBERG][DELTA] Introduce row level operation test for data lake format
- [KYUUBI #1582] Use ClientTypeSignature to further analysis of trino column type
- [KYUUBI #1607] [DOC] Add operation and backend service metrics in metrics doc
- [KYUUBI #1579] Implement basic ability of executing statement in Flink engine
- [KYUUBI #1575] Implement api: /${version}/operations/${operation_identifier}/resultsetmetadata
- [KYUUBI #1593] use user set host or ip instead of read hostname from user set
- [KYUUBI #1591] Watchdog support for Spark-3.2
- [KYUUBI #1587] [SUB-TASK][KPIP-2] Bump Flink 1.14.2
- [KYUUBI #1577] Add DropIgnoreNonexistent Rule.
- [KYUUBI #1586] Add time metric on each KyuubiBackendService method
- [KYUUBI #1578] Introduce flink-sql-client dependency to reduce some duplicated code
- [KYUUBI #1499] Introduce DataFrameHolder for cli result fetching
- [KYUUBI #1550] Provide a specific user guide about connecting to kerberized kyuubi
- [KYUUBI #1555][FLINK] Bump flink version to 1.14.0
- [KYUUBI #1554] Add kyuubi.engine.pool.name configuration
- [KYUUBI #1460] Bump Hudi 0.10.0
- [KYUUBI #1559] Bump Jersey 2.34
- [KYUUBI #1568] Replace sessionDetail with sessionEvent
- [KYUUBI #1565] Move time functions to RowSetUtils and move schema to spark package
- [KYUUBI #1567] [Bug] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
- [KYUUBI #1571] [BUILD] Correct build command in build/dist
- [KYUUBI #1558] Bump Jackson 2.12.5
- [KYUUBI #1556] Shorten kyuubi.session.engine.check.interval to one minute
- [KYUUBI #1560] Align all Jackson libs version
- [KYUUBI #1539] Replace operationDetail with KyuubiEvent
- [KYUUBI #1557] [DOC] The TTL Of Kyuubi Engines
- [KYUUBI #1174][FOLLOWUP] change configuration(ha.zookeeper.publish.configs) default value to false
- [KYUUBI #1515] Add RowSet for trino engine
- [KYUUBI #1525][FLINK] Implement GetCatalogs operation and do the further initialization
- [KYUUBI #1548] Get docs version from project.version
- [KYUUBI #1544] Update the mailing list to send announcement
- [KYUUBI #1542] Move FetchIterator into kyuubi-common for multi-engine support
- [KYUUBI #1541] Remove keys sync step for Kyuubi finalize release
- [KYUUBI #1533] Add documentation about Kyuubi docker-image-tool using Spark image as BASE_IMAGE
- [KYUUBI #1535] Remove duplicate hive client version property
- [KYUUBI #1531] Add kyuubi version in engineSpace
- [KYUUBI #1528] Record the kyuubi server ip address in event log
- [KYUUBI #1527] [DOC] Improve High Availability Guide
- [KYUUBI #1516] Implement api: /${version}/operations/${operation_identifier}
- [KYUUBI #1480] Fix bug in docker-image-tool & Provider image way to config SPARK instead of local copy
- [KYUUBI #1393][TASK-2] Add operation number metric
- [KYUUBI #1523] Refine usage about option ‘–namespace’ in kyuubi-ctl
- [KYUUBI #1522] Pass the client ip to engine
- [KYUUBI #1526] [DOC] Update kyuubi_layers.drawio to add driver layer
- [KYUUBI #1521] [BUILD] Migrate to actions/cache@v2
- [KYUUBI #1489] Support operation log for ExecuteScala
- [KYUUBI #1520] [BUILD] Switch to setup-java@v2
- [KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
- [KYUUBI #1511] Initialize kyuubi trino engine module
- [KYUUBI #1513] Added support liveness and readiness for kyuubi pod
- [KYUUBI #1501] Introduce operationsResource
- [KYUUBI #1503] Introduce FlinkThriftBinaryFrontendService to do the further initialization
- [KYUUBI #1487] Correct the KEYS link and add script to generate vote and announcement
- [KYUUBI #1496] Support tpcds benchmark
- [KYUUBI #1508] Add Kyuubi version in UI
- [KYUUBI #1504] Support to capture console out/error into interpreter output for ExecuteScala
- [KYUUBI #1505] Move ServiceNodeInfo to a separate file
- [KYUUBI #1492] Initialize kyuubi flink sql engine module
- [KYUUBI #1445] [Kyuubi #1444] Implement api: /${version}/sessions/${session_identifier}/operations/${operation_identifier}
- [KYUUBI #1490] Introduce the basic framework for running scala
- [KYUUBI #1493] Make a reasonable thread pool size for listing file statuses
- [KYUUBI #1379] Make SESSION_ENGINE_LAUNCH_ASYNC true by default
- [KYUUBI #1486] Enable delta test on Spark 3.2 with delta 1.1.0
- [KYUUBI #1484] Add a dependency describe for kyuubi on azure delta-lake doc.
- [KYUUBI #1483] Revamp KyuubiSessionImpl and KyuubiSyncThriftClient
- [KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
- [KYUUBI #1382] Sync the flink-provided profile in docs and testing suite comments
- [KYUUBI #1481] Add z-order docs
- [KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
- [KYUUBI #1478] Docker-image-tool.sh awareness of incorrectly configured SPARK_HOME
- [KYUUBI #1472] allow the engine not to self-terminate.
- [KYUUBI #1473] Exit gracefully when engine idle
- [KYUUBI #1471] Improve log if user specify the spark principal and keytab but not same with proxy user
- [KYUUBI #1446] Decouple zookeeper from abstract ServiceDiscovery
- [KYUUBI #1470] Git ignore kyuubi-server metrics
- [KYUUBI #1467] Add The Doc of Intergrate Azure Blob Storage Based Delta Lake with Kyuubi
- [KYUUBI #1469] Add cancel vote template and add release notes into vote template
- [KYUUBI #1462] [DOC] Use relative paths instead of absolute paths
- [KYUUBI #1466] Unify the guava version for kyuubi server and kyuubi beeline
- [KYUUBI #1463] Enabled to preserve symbolic links when copying dist dir
- [KYUUBI #1454] Add Doc About Deploy Kyuubi On Kubernetes
- [KYUUBI #1459] Kyuubi Server Event Test change
- [KYUUBI #1461] [DOC] Remove deprecated dist repo directory for deprecated release candidates
- [KYUUBI #1396][K8S] Add docker image tools and replace Dockerfile
- [KYUUBI #1443] MaxPartitionStrategy support file source based table.
- [KYUUBI #1050] Add KyuubiServerInfoEvent
- [KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl.
- [KYUUBI #1442] Fix encode MySQLHandshakePacket UT
- Ada Wong
- Brian Yue
- Cheng Pan
- Fei Wang
- Fu Chen
- HYBG-1126
- I521853
- Jeff Zhang
- Kent Yao
- Martin Tzvetanov Grigorov
- Muru Muthusamy
- Paul Lam
- Paul Lin
- Rishi Kumar Ray
- Simon
- SteNicholas
- Tianlin Liao
- Wang Zhen
- fwang12
- hongdongdong
- hwk42
- jiaoqingbo
- jing10.gao
- mask
- minyk
- odone
- rayliu
- senmiaoliu
- shenbing
- simon
- sundapeng
- sunfangbin
- sychen
- ulysses-you
- wForget
- xifeng yang
- yanghua
- zhenjiaguo
- zhichaoleo
- zhouyifan279
- zwangsheng
[KYUUBI #1449] Fix when KyuubiServer initialize fail but not exit
[KYUUBI #1458] Delta lake table columns won’t show up in DBeaver.
[KYUUBI #1473] Exit gracefully when engine idle
[KYUUBI #1567] Expose HADOOP_CONF_DIR to Kyuubi beeline to fix “GSS initiate failed” error
[KYUUBI #1439] Add KYUUBI_CTL_JAVA_OPTS to configure java opts of kyuubi-ctl
[KYUUBI #1806] Fix LaunchEngine may be closed multiple times
[KYUUBI #1731] Kyuubi server should not fail to start when Hadoop FileSystem class not found
[KYUUBI #1509] Make KYUUBI_WORK_DIR_ROOT as the default root path.
[KYUUBI #1800] [1.4] Remove oom hook
[KYUUBI #1784] Fix float types lose precision
[KYUUBI #1748] bin/kyuubi-zk-cli should has execute permission
[KYUUBI #1722] [NOTICE] Update NOTICE for 2022
[KYUUBI #1611] Fix swagger-ui redirect wrong to other service address
[KYUUBI #1225] [KYUUBI #1228] Add kyuubi-extension-spark-3-2 module and profile to support latest spark-3.2
[KYUUBI #939] Add Z-Order extensions to support optimize SQL
[KYUUBI #913] Support long running SQL engine without principal and keytab provided
[KYUUBI #1219] Support MySQL Protocol Frontend
[KYUUBI #1349] Add new conf kyuubi.frontend.protocols
[KYUUBI #1206] Support GROUP engine share level
[KYUUBI #1018] Set spark.sql.execution.topKSortFallbackThreshold to 10000
[KYUUBI #1059] Add Plan Only Operations
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #1159] Add Session stats on Kyuubi Query Engine Page
[KYUUBI #1198] Support to incremental collect statement result
[KYUUBI #1248] Change kyuubi.engine.session.initialize.sql default value to Nil
[KYUUBI #1286] Increase kyuubi.session.engine.initialize.timeout default to 3min
[KYUUBI #1323] Introduce EngineType to distinguish multiple engines
[KYUUBI #1262] Support both KERBEROS and PLAIN authentication at the same time
[KYUUBI #1160] Support to config operation log root dir both for kyuubi server and engine sides
[KYUUBI #1204] Enhance zookeeper authentication and ACLs
[KYUUBI #1039] Application stop log redirect append to engineLog
[KYUUBI #703] Integrate test with Hudi 0.9.0
[KYUUBI #1338] Integrate test with Iceberg 0.12.1
[KYUUBI #1131] Rename KyuubiDriver to KyuubiHiveDriver
[KYUUBI #1346] Support launch query engine asynchronously during opening session
[KYUUBI #1377] Support to get launch engine log asynchronously with KyuubiConnection
[KYUUBI #1414] Add kyuubi-hive-beeline module to support KyuubiConnection and KyuubiStatement
[KYUUBI #1047] Use deployment to run kyuubi server HA on K8s
[KYUUBI #1223] Remove dead module kyuubi-spark-monitor
[KYUUBI #1277] Add UDF engine_id
[KYUUBI #660] Add UDF session_user
[KYUUBI #1190] Enhance error log detection in case lost the exception log
[KYUUBI #1067] Catch exception if logRoot is not exist
[KYUUBI #884] [FOLLOWUP] Fix catalog in KyuubiDatabaseMetaData#getTables
[KYUUBI #1108] Register KyuubiDriver in ServiceLoader
[KYUUBI #1094] [BUGFIX #1068]Support upload file to HDFS
[KYUUBI #1034] Engine may deadlock when close operationLog
[KYUUBI #1057] [KYUUBI#1056] Output error log when currentEngine is None
[KYUUBI #1158] [INFRA] Update ANNOUNCE mail template
[KYUUBI #1107] [INFRA] Add release mail templates
[KYUUBI #1141] Remove redundant unit
[KYUUBI #1134] [TEST] DataLake suites should clean up withKyuubiConf instead of extraConfigs
[KYUUBI #1130] [DOCS] Restore Kyuubi logo image size
[KYUUBI #1125] [FOLLOWUP] Compress and remove duplicated new logo and keep legacy logo
[KYUUBI #1125] A new version of logo flie, apache information included.
[KYUUBI #1104] Fix release script finalize_svn
[KYUUBI #1096] Remove never expired declaration in NOTICE
[KYUUBI #1263] Kyuubi auxiliary UDF failed on Spark Yarn mode
[KYUUBI #1267] Modify comments for the golden file test suite and fix it
Fully verified with the latest Spark 3.0/3.1
Support build on JDK8(default), JDK11
Provide enhanced AQE in Kyuubi Spark Extensions (for Spark 3.1)
Provide several auxiliary SQL functions as a supplement to Spark’s built-in Functions
Major improvements of Spark on Kubernetes, include documents, integration tests, tools, etc.
Support engine/session level configurable initialize SQL statements
Support custom authentication implementation
Support stop Spark engine through Web UI
Support single session mode
Several improvements of observability
Fully tested with the all data lake platforms Delta, Iceberg
Fully tested with MiniYARNCluster
[KYUUBI #631] Add kyuubi-spark-extensions-3-1 module
[KYUUBI #657][KYUUBI #659] Provides auxiliary SQL functions as supplement to Spark’s built-in Functions
[KYUUBI #897] Support stop Spark engine through Web UI
[KYUUBI #762] Add Kyuubi Hive JDBC Module
[KYUUBI #926] Support add repartition for OptimizedCreateHiveTableAsSelectCommand
[KYUUBI #670] KyuubiSQLException support sqlState and errorCode
[KYUUBI #707] Respect spark.sql.catalogImplementation in engine
[KYUUBI #641] Support custom authentication
[KYUUBI #751] Support single session mode
[1.2][KYUUBI #457] Support configurable initialize sql statement for engine startup
[KYUUBI #857] Support configurable initialize SQL statement for each session
[KYUUBI #755] Default build against Spark 3.1
[KYUUBI #693][KYUUBI #760] Support build against JDK11
[KYUUBI #768][K8S] Add module shuffle-files-cleaner
[KYUUBI #844][K8S] Exposing Kyuubi as a NodePort service
[KYUUBI #859][K8S] Add kubernetes configmap
[KYUUBI #656][K8S] Document how to deploy Kyuubi engines on Kubernetes
[KYUUBI #776][K8S] Run kyuubi on Kubernetes - make basic dockerfile and example
[KYUUBI #444][KYUUBI #854][TEST][K8S] Add minikube for K8s integration test
[KYUUBI #712][LDAP] Add a new config property authentication.ldap.guidKey
[KYUUBI #643][TEST] Test Detla 1.0.0 with Spark 3.1
[KYUUBI #948][TEST] Test Iceberg 0.12.0 with Spark 3.0/3.1
[KYUUBI #527][TEST][YARN] Test with MiniYARNCluster
[KYUUBI #737] Add monitor module
[KYUUBI #727] Add the listener for each SQL
[KYUUBI #767] Add statement event tracking
- [1.2][KYUUBI #629] Refine distributed lock to lock only engine bootstrap
[KYUUBI #416] Detected Dependency List Change for better dependency management
[KYUUBI #487][KYUUBI #566] Add TPC-DS DDL test cases
[KYUUBI #871] Change module name kyuubi-main to kyuubi-server
Release Notes - 1.6.0-incubating
2022 Sep 6
Highlight
Server
Client
Engine
Plugin
Docs
ChangeList
Credits
Last but not least, this release would not have been possible without the following contributors:
Release Notes - 1.5.2-incubating
2022 Jun 18
ChangeList
Credits
Last but not least, this release would not have been possible without the following contributors:
Release Notes - 1.5.1-incubating
2022 Apr 21
ChangeList
Credits
Last but not least, this release would not have been possible without the following contributors:
Release Notes - 1.5.0-incubating
2022 Mar 25
Highlight
ChangeList
Credits
Last but not least, this release would not have been possible without the following contributors:
Apache Kyuubi(Incubating) 1.4.1-incubating Release Notes
2022 Jan 31
Hi all,
Apache Kyuubi (Incubating) 1.4.1-incubating is now released. It is a maintenance release containing stability fixes which is based on branch-1.4. Mainly fix some issues of the event log.
Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark and designed to support more engines (i.e. Apache Flink). Please refer to Apache Kyuubi (Incubating) to learn more.
To download Apache Kyuubi (Incubating) 1.4.1-incubating, visit the downloads page.
Highlight
Others
Credits
Thank you for the following contributors who helped to review and commit to Apache Kyuubi (Incubating) 1.4.1-incubating version, and the order is based on the lexicographical order:
Cheng Pan, Fei Wang, Fu Chen, Muru Muthusamy, Wang Zhen, sunfangbin, sychen, ulysses-you, yanghua, zhenjiaguo, zhouyifan279, zwangsheng
Apache Kyuubi(Incubating) 1.4.0-incubating Release Notes
2021 Dec 10
Hi all,
In this release, Kyuubi supports the latest Spark 3.2, Z-Order to optimize sql, long running SQL engine without principal and keytab provided, mysql protocol frontend and mysql client. Other major updates includes GROUP engine.share.level support, asynchronous opening session, user-friendly kyuubi beeline and zookeeper authentication enhancement.
To download Apache Kyuubi (Incubating) 1.4.0-incubating, visit the downloads page.
Highlight
Fully verified with the latest Spark 3.2
Support Z-Order to optimize SQL
Support long running SQL engine without principal and keytab provided
Support GROUP engine share level
Enhance USER engine share level support engine pool
Enhance zookeeper authentication and ACLs
Add more Kyuubi defined functions
Fully tested with all data lake platform Delta Lake, Iceberg and Hudi
Support both KERBEROS and PLAIN authentication at the same time
Support MySQL protocol frontend and MySQL client(experimental)
Support to launch query engine asynchronously during opening session and user-friendly Kyuubi Hive JDBC and BeeLine
Functionality
Integration
Hive JDBC
Others
Credits
Last but not least, this release would not have been possible without the following contributors: AnybodyHome, Brian Yue, Cheng Pan, Fei Wang, Fu Chen, Jagadesh Adireddi, Kent Yao, Min Zhao, Guoqing Yang, h, happytofly, hongdongdong, jiaoqingbo, qiuliang, qphien, senmiaoliu, simon, sunfangbin, sychen, timothy65535, ulysses-you, wFoget, xiebo03, xiongyinke, yanghua, yanyu34946, zhang1002, zhenjiaguo, zhouyifan279, zwangsheng, 张宇翔
Apache Kyuubi(Incubating) 1.3.1-incubating Release Notes
2021 Oct 25
Hi all,
Apache Kyuubi (Incubating) 1.3.1-incubating is now released. It is a maintenance release containing stability fixes which is based on branch-1.3. Mainly fix some issues of the event log.
Apache Kyuubi (Incubating) is a distributed multi-tenant JDBC server for large-scale data processing and analytics, built on top of Apache Spark and designed to support more engines (i.e. Apache Flink). Please refer to Apache Kyuubi (Incubating) to learn more.
To download Apache Kyuubi (Incubating) 1.3.1-incubating, visit the downloads page.
Highlight
Others
Knwon Issues
Credits
Thank you for the following contributors who helped to review and commit to Apache Kyuubi (Incubating) 1.3.1-incubating version, and the order is based on the commit time:
qiuliang, hongdd, Yuxiang Zhang, Cheng Pan, happytofly, timothy, cxzl25, Xiduo You, Simon
Apache Kyuubi(Incubating) 1.3.0-incubating Release Notes
2021 Sep 14
To download Apache Kyuubi (Incubating) 1.3.0-incubating, visit the downloads page.