Release Notes - 1.6.0-incubating

Highlight

Server

• Support Batch(Jar) Job submission
• Support Thrift HTTP mode
• Support Etcd as Discovery Service
• Support JDBC authentication mechanism
• Unify the authentication for Thrift and REST v1 API
• Enhance metrics system

Client

• Introduce REST client for Batch(Jar) Job submission
• Decouple Hive and Hadoop dependencies from builtin JDBC driver
• Builtin JDBC driver supports using keytab for Kerberos authentication
• Enhance beeline to support Spark console progress bar

Engine

• Fully verified with the latest Spark 3.1/3.2/3.3
• Fully verified with the latest Flink 1.14/1.15
• Fully verified with the Trino 363
• Support Hive backend Engine (Beta)
• Support JDBC backend Engine (Beta)

Plugin

• Introduce Spark TPC-DS connector
• Introduce Spark TPC-H connector
• Introduce Spark Authz (Apache Ranger) plugin

Docs

• User Documentation refactoring and improvement

ChangeList

• [KYUUBI #3363] Kyuubi Beeline requires commons-lang
• [KYUUBI #3353] Backport HIVE-21899 - Utils.getCanonicalHostName() may return IP address depending on DNS infra
• [KYUUBI #3355] Backport HIVE-20583 - Use canonical hostname only for kerberos auth in HiveConnection
• [KYUUBI #3348] Specifies none checks to be performed on Javadoc comments for maven-javadoc-plugin
• [KYUUBI #3347] [MINOR] Relocation AccessControlException
• [KYUUBI #3336] Use StageAttempt instead of StageId in SQLOperationListener
• [KYUUBI #3023] [FOLLOWUP] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
• [KYUUBI #3316] [BUILD] Enable spark-3.3 profile for license check on GA
• [KYUUBI #3254] Supplement the licenses of support etcd discovery
• [KYUUBI #3301] Construct lifetimeTerminatingChecker only when needed
• [KYUUBI #3272] Synchronize graceful shutdown with main stop sequence
• [KYUUBI #3281] [MINOR] Use AccessControlException instead of RuntimeException if check privilege failed
• [KYUUBI #3222] [FOLLOWUP] Fixing placeholder and config of user in JDBC Authentication Provider
• [KYUUBI #3275] [KYUUBI 3269] [DOCS] Doc for JDBC authentication provider
• [KYUUBI #3217] [DOCS] Doc for using Marcos in row-level filter in Authz
• [KYUUBI #3297] [MINOR] Null is replaced by KyuubiSQLException.featureNotSupported()
• [KYUUBI #3244] Bump Hudi 0.12.0
• [KYUUBI #3287] Exclude reload4j from hadoop-minikdc
• [KYUUBI #3222] [FOLLOWUP] Introdude JdbcUtils to simplify code
• [KYUUBI #3020] [FOLLOWUP] Refactor the code style
• [KYUUBI #3020] kyuubi ldap add new config property kyuubi.authentication.ldap.bindpw and kyuubi.authentication.ldap.attrs
• [KYUUBI #3226] Privileges should be checked only once in RuleAuthorization
• [KYUUBI #3156] Expose REST frontend connection metrics
• [KYUUBI #3241] [DOCS] Update Develop Tools / Building a Runnable Distribution
• [KYUUBI #3255] Add miss engine type config docs
• [KYUUBI #3214] Plan only mode should unset when mode value is incorrect
• [KYUUBI #3239] [SUBTASK] DorisSQLEngine - Add integration tests
• [KYUUBI #3252] Fix the problem that |release| in the document was not replaced correctly
• [KYUUBI #3247] Minor clean up Kyuubi JDBC code
• [KYUUBI #3222] JDBC Authentication Provider for server
• [KYUUBI #3243] Move trait Logging#initializeLogging to object Logging
• [KYUUBI #3245] Add spark-3.3 profile in building.md
• [KYUUBI #3184] OperationResource rowset api should have default values for maxrows and fetchorientation
• [KYUUBI #3220] Make kyuubi.engine.ui.stop.enabled false in HistoryServer
• [KYUUBI #1776] [FOLLOWUP] Fill empty td tag for Failure Reason column in EngineTable
• [KYUUBI #3157] [DOC] Modify logging doc due to using log4j2 instead of log4j
• [KYUUBI #3228] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-DS
• [KYUUBI #3138] [SUBTASK] DorisSQLEngine - Add jdbc engine to dist
• [KYUUBI #3230] Flink SQL engine supports run across versions
• [KYUUBI #3072] [DOC] Add a doc of Flink Table Store for Flink SQL engine
• [KYUUBI #3170] Expose thrift binary connection metrics
• [KYUUBI #3227] SparkConfParser supports parse bytes and time
• [KYUUBI #3219] Error renew delegation tokens: Unknown version of delegation token 8
• [KYUUBI #3080] [DOC] Add a doc of the Flink Table Store for the Trino SQL Engine
• [KYUUBI #3107] [SUBTASK] DorisSQLEngine - Add process builder (#3123)
• [KYUUBI #3211] [SUBTASK] Connectors for Spark SQL Query Engine -> TPC-H
• [KYUUBI #3206] Change Flink default version to 1.15
• [KYUUBI #833] Check if spark.kubernetes.executor.podNamePrefix is invalid
• [KYUUBI #3098] Unify the event log code path
• [KYUUBI #3210] [DOCS] Mention Kyuubi Spark SQL extension supports Spark 3.3
• [KYUUBI #3204] Fix duplicated ldapServer#close in LdapAuthenticationProviderImplSuite
• [KYUUBI #3209] Support configure TPC-H connector in runtime
• [KYUUBI #3200] Make KyuubiSessionEvent.sessionId clear
• [KYUUBI #3186] Support applying Row-level Filter and Data Masking policies for DatasourceV2 in Authz module
• [KYUUBI #2584] [INFRA] Migrate CI to Ubuntu 22.04
• [KYUUBI #3172] [FLINK] Fix failed test cases in Flink 1.15
• [KYUUBI #3203] [DOCS] Fix typo
• [KYUUBI #3192] Refactor TPCDSConf
• [KYUUBI #3180] Add component version util
• [KYUUBI #3162] Bump Hadoop 3.3.4
• [KYUUBI #3191] [DOCS] Add missing binary scala version in engine jar name
• [KYUUBI #3199] [BUILD] Fix travis JAVA_HOME
• [KYUUBI #3194] [Scala-2.13] Refine deprecated config
• [KYUUBI #3198] [DOCS] Fix index of Hudi Flink connector
• [KYUUBI #3189] [BUILD] Bump jetcd 0.7.3 and pin Netty dependencies
• [KYUUBI #3190] [BUILD] Use jdk_switcher to setup JAVA_HOME
• [KYUUBI #3145] Bump log4j from 2.17.2 to 2.18.0
• [KYUUBI #3135] Bump gRPC from 1.47.0 to 1.48.0
• [KYUUBI #3178] Add application operation docs
• [KYUUBI #3174] Update MATURITY for C30, RE50, CO20, CO40, CO50, CS10, IN10
• [KYUUBI #3175] Add session conf advisor docs
• [KYUUBI #3141] Trino engine etcd support
• [KYUUBI #3150] Expose metadata request metrics
• [KYUUBI #3070] [DOC] Add a doc of the Hudi connector for the Flink SQL Engine
• [KYUUBI #3104] Support SSL for Etcd
• [KYUUBI #3152] Introduce JDBC parameters to control connection timeout
• [KYUUBI #3136] Change Map to a case class ApplicationInfo as the application info holder
• [KYUUBI #2240] [SUBTASK] Skip add metadata manager if frontend does not support rest
• [KYUUBI #3131] Improve operation state change logging
• [KYUUBI #3158] Fix npe issue when formatting the kyuubi-ctl output
• [KYUUBI #3160] [DOCS] Dependencies links in Connectors for Spark SQL Query Engine pages jump to wrong place #3160 (#3161)
• [KYUUBI #3154] [SUBTASK] Connectors for Spark SQL Query Engine -> TiDB/TiKV
• [KYUUBI #3082] Add iceberg connector doc for Trino SQL Engine
• [KYUUBI #3071] [DOC] Add iceberg connector for Flink SQL Engine
• [KYUUBI #3153] Move batch util class to kyuubi rest sdk for programing friendly
• [KYUUBI #3067] [DOC] Add Flink Table Store connector doc for Spark SQL Engine
• [KYUUBI #3148] Change etcd docker image to recover arm64 CI
• [KYUUBI #3119] [TEST] Using more light-weight SparkPi for batch related tests
• [KYUUBI #3023] Kyuubi Hive JDBC: Replace UGI-based Kerberos authentication w/ JAAS
• [KYUUBI #3144] Remove deprecated KyuubiDriver in services manifest
• [KYUUBI #3143] Check class loadable before applying SLF4JBridgeHandler
• [KYUUBI #3139] Override toString method for rest dto classes
• [KYUUBI #3087] Convert the kyuubi batch conf with spark. prefix so that spark could identify
• [KYUUBI #3133] Always run Flink statement in sync mode
• [KYUUBI #3121] [CI] Fix GA oom issue
• [KYUUBI #3126] Using markdown 3.3.7 for kyuubi document build
• [KYUUBI #3106] Correct RelMetadataProvider used in flink-sql-engine
• [KYUUBI #3069] [DOC] Add Iceberg connector doc for Spark SQL Engine
• [KYUUBI #3068] [DOC] Add the Hudi connector doc for Spark SQL Query Engine
• [KYUUBI #3108] [DOC] Fix path errors in the build document
• [KYUUBI #3111] Replace HashMap with singletonMap
• [KYUUBI #3113] Bump up delta lake version from 2.0.0rc1 to 2.0.0
• [KYUUBI #3101] [SUBTASK][#3100] Build the content for extension points documentation
• [KYUUBI #3102] Fix multi endpoints for etcd
• [KYUUBI #3008] Bump prometheus from 0.14.1 to 0.16.0
• [KYUUBI #3095] Move TPC-DS/TPC-H queries to unique folder
• [KYUUBI #3094] Code refactor on Kyuubi Hive JDBC driver
• [KYUUBI #3092] Replace apache commons Base64 w/ JDK
• [KYUUBI #3093] Fix Kyuubi Hive JDBC driver SPNEGO header
• [KYUUBI #3050] Bump Apache Iceberg 0.14.0
• [KYUUBI #3044] Bump Spark 3.2.2
• [KYUUBI #3052] [FOLLOWUP] Do not use the ip in proxy http header for authentication to prevent CVE
• [KYUUBI #3051] Support to get the real client ip address for thrift connection when using VIP as kyuubi server load balancer
• [KYUUBI #3046] [Metrics] Add meter metrics for recording the rate of the operation state for each kyuubi operation
• [KYUUBI #3045] [FOLLOWUP] Correct the common options and add docs for kyuubi-admin command
• [KYUUBI #3076] [SUBTASK][#3039] Add the docs for rest api - Batch Resource
• [KYUUBI #3077] Remove meaningless statement override in LaunchEngine
• [KYUUBI #3018] [SUBTASK] DorisSQLEngine - GetColumns Operation
• [KYUUBI #3073] CredentialsManager should use appUser to renew credential
• [KYUUBI #3065] Support to retry the killApplicationByTag for JpsApplicationOperation
• [KYUUBI #3054] Add description of the discovery client in the conf doc
• [KYUUBI #3043] [FOLLOWUP] Restore accidentally removed public APIs of kyuubi-hive-jdbc module
• [KYUUBI #3060] [SUBTASK][#3059] Build content of the connector document section
• [KYUUBI #3045] Support to do admin rest request with kyuubi-adminctl
• [KYUUBI #3055] Expose client ip address into batch request conf
• [KYUUBI #3052] Support to get the real client ip address for http connection when using VIP as kyuubi server load balancer
• [KYUUBI #3043] Clean up Kyuubi Hive JDBC client
• [KYUUBI #3047] Fallback krb5 conf to OS if not configured
• [KYUUBI #2644] Add etcd discovery client for HA
• [KYUUBI #3040] [SUBTASK][#3039] Build the skeleton of client side documentation
• [KYUUBI #2974] [FEATURE] EOL Support for Spark 3.0
• [KYUUBI #3042] Kyuubi Hive JDBC should throw KyuubiSQLException
• [KYUUBI #3037] Handles configuring the JUL -> SLF4J bridge
• [KYUUBI #3033] [Bug] Kyuubi failed to start due to PID directory not exists
• [KYUUBI #3028] [FLINK] Bump Flink versions to 1.14.5 and 1.15.1
• [KYUUBI #2478] [FOLLOWUP] Fix bin/beeline without -u exits unexpectedly
• [KYUUBI #3025] Fix the kyuubi restful href link format issue
• [KYUUBI #3007] Bump scopt from 4.0.1 to 4.1.0
• [KYUUBI #3019] Backport HIVE-21538 - Beeline: password source though the console reader did not pass to connection param
• [KYUUBI #3017] kyuubi-ctl should print error message to right place
• [KYUUBI #3010] Bump Jetty from 9.4.41.v20210516 to 9.4.48.v20220622
• [KYUUBI #3011] Bump swagger from 2.1.11 to 2.2.1
• [KYUUBI #3009] Bump Jersey from 2.35 to 2.36
• [KYUUBI #2801] [FOLLOWUP] Also check whether the batch main resource path is in local dir allow list
• [KYUUBI #3012] Remove unused thrift request max attempts and related ut
• [KYUUBI #3005] [DOCS] Correct spelling errors and optimizations in ‘Building Kyuubi Documentation’ part
• [KYUUBI #3004] Clean up JDBC shaded client pom and license
• [KYUUBI #2895] Show final info in trino engine
• [KYUUBI #2984] Refactor TPCDS configurations using SparkConfParser
• [KYUUBI #2996] Remove Hive storage-api dependencies from Kyuubi Hive JDBC
• [KYUUBI #2997] Use spark shim set current namespace
• [KYUUBI #2994] Remove Hive common dependencies from Kyuubi Hive JDBC
• [KYUUBI #2850] [FOLLOWUP] Replace log4j2.properties by log4j2.xml
• [KYUUBI #2801] Add local dir allow list and check the application access path URI
• [KYUUBI #2953] Support to interrupt the thrift request if remote engine is broken
• [KYUUBI #2999] Fix Kyuubi Hive Beeline dependencies
• [KYUUBI #2850] [FOLLOWUP] Fix default log4j2 configuration
• [KYUUBI #2977] [BATCH] Using KyuubiApplicationManger#tagApplication help tag batch application
• [KYUUBI #2993] Fix typo in KyuubiConf and mark more config entries server only
• [KYUUBI #2987] Remove Hive shims-common and shims-0.23 dependencies from Kyuubi Hive JDBC
• [KYUUBI #2985] Prompt configuration when starting engine timeout
• [KYUUBI #2989] Remove HS2 active-passive support in Kyuubi Hive JDBC client
• [KYUUBI #2983] Remove Hive llap-client dependencies from Kyuubi Hive JDBC
• [KYUUBI #2981] Improve TPC-DS scan performance
• [KYUUBI #2917] Remove Hive service dependencies from Kyuubi Hive JDBC
• [KYUUBI #2868] [K8S] Add KubernetesApplicationOperation
• [KYUUBI #2979] Fix helm icon url
• [KYUUBI #2978] [SUBTASK][KPIP-4] If batch app status not found from cluster manager, fall back to metadata store
• [KYUUBI #2975] Code improvement in rest client
• [KYUUBI #2964] [SUBTASK][KPIP-4] Refine the batch response and render
• [KYUUBI #2976] Expose session name into kyuubi engine tab
• [KYUUBI #2850] [FOLLOWUP] Provide log4j2.xml.template in binary and use log4j2-defaults.xml
• [KYUUBI #2963] Bump Delta 2.0.0rc1
• [KYUUBI #2918] [Bug] Kyuubi integrated Ranger failed to query: table stats must be specified
• [KYUUBI #2966] Remove TProtocolVersion from SessionHandle/OperationHandle
• [KYUUBI #2972] Using stdout for the output of kyuubi-ctl
• [KYUUBI #2973] Decorate LOG in the RetryableRestClient with static final
• [KYUUBI #2962] [SUBTASK][KPIP-4] Throw exception if the metadata update count is zero
• [KYUUBI #2956] Support to config the connect/socket timeout of rest client for kyuubi-ctl
• [KYUUBI #2960] TFrontendService.SERVER_VERSION shall be HIVE_CLI_SERVICE_PROTOCOL_V11
• [KYUUBI #2957] [SUBTASK][KPIP-4] Use canonical host name for kyuubi instance
• [KYUUBI #2952] Remove OperationType from OperationHandle for simplification
• [KYUUBI #2955] BatchRequest args fix: need toString operation for different data types
• [KYUUBI #2949] Flaky test: execute statement - analysis exception
• [KYUUBI #2951] No need to extend CompositeService for MetadataManager
• [KYUUBI #2948] Remove thrift request timeout for KyuubiSyncThriftClient
• [KYUUBI #2943] [Bug][K8S] Remove Start Local Kyuubi Server For Kyuubi On K8S Test
• [KYUUBI #2924] Correct the frontend server start state
• [KYUUBI #886] [FOLLOWUP] Support to reload hadoop conf for KyuubiTHttpFrontendService
• [KYUUBI #2929] Kyuubi integrated Ranger does not support the CTAS syntax
• [KYUUBI #2935] Support spnego authentication for thrift http transport mode
• [KYUUBI #2894] Add synchronized for the ciphers of internal security accessor
• [KYUUBI #2927] Fix the thread in ScheduleThreadExecutorPool can’t be shutdown immediately
• [KYUUBI #2876] Bump Hudi 0.11.1
• [KYUUBI #2922] Clean up SparkConsoleProgressBar when SQL execution fails
• [KYUUBI #2919] Fix typo and wording for JDBCMetadataStoreConf
• [KYUUBI #2920] Fix typo for mysql metadata schema
• [KYUUBI #2890] Get the db From Sparksession When TableIdentifier’s Database Field Is Empty
• [KYUUBI #2911] [SUBTASK][KPIP-4] If the kyuubi instance unreachable, support to backfill state from resource manager and mark batch closed by remote kyuubi instance
• [KYUUBI #2912] [INFRA][DOCS] Improve release md
• [KYUUBI #2905] [DOCS] Update the number of new committers in MATURITY.md
• [KYUUBI #2745] [SUBTASK] DorisSQLEngine - GetTables Operation
• [KYUUBI #2628] [FOLLOWUP] Support waitCompletion for submit batch
• [KYUUBI #2827] [BUILD][TEST] Decouple integration tests from kyuubi-server
• [KYUUBI #2898] Bump maven-surefire-plugin 3.0.0-M7
• [KYUUBI #2628] [FOLLOWUP] Reuse the kyuubi-ctl batch commands for SubmitBatchCommand
• [KYUUBI #2897] Remove Hive metastore dependencies from Kyuubi Hive JDBC
• [KYUUBI #2782] Decouple Kyuubi Hive JDBC from Hive Serde
• [KYUUBI #2854] Add exception field in KyuubiSessionEvent
• [KYUUBI #2873] [INFRA][DOCS] Improve release template script
• [KYUUBI #2761] Flaky Test: engine.jdbc.doris.StatementSuite - test select
• [KYUUBI #2834] [SUBTASK][KPIP-4] Support to retry the metadata requests on transient issue and unblock main thread
• [KYUUBI #2543] Add maxPartitionBytes configuration for TPC-DS connecter
• [KYUUBI #886] Add HTTP transport mode support to KYUUBI - no Kerberos support
• [KYUUBI #2628] [FOLLOWUP] Refine kyuubi-ctl batch commands
• [KYUUBI #2859] [SUBTASK][KPIP-4] Support --conf for kyuubi-ctl
• [KYUUBI #2888] Bump Spark-3.3.0
• [KYUUBI #2708] Open engine session and renew engine credentials in the one
• [KYUUBI #2668] [FOLLOWUP] Add log4j for rest client test
• [KYUUBI #2881] [SUBTASK][KPIP-4] Rest client supports retry request if catch net exception
• [KYUUBI #2883] [Bug] java.lang.NoClassDefFoundError: org/apache/hadoop/hive/common/ValidWriteIdList in HiveDelegationTokenProvider#initialize
• [KYUUBI #2813] Bump Iceberg 0.13.2
• [KYUUBI #2628] [SUBTASK][KPIP-4] Implement kyuubi-ctl for batch job operation
• [KYUUBI #2872] Catch the exception for the iterator job when incremental collect is enabled
• [KYUUBI #2870] Fix sf0 query error in TPCH
• [KYUUBI #2861] [FOLLOWUP][GA] Daily publish snapshot with profile spark-3.3
• [KYUUBI #2865] Bump Spark 3.3.0-rc6
• [KYUUBI #2863] Unify the logic of tpch and tpcds to generate golden file
• [KYUUBI #2862] [BUILD] Release script supports Spark 3.3
• [KYUUBI #2861] [GA] Daily publish snapshot with profile spark-3.3
• [KYUUBI #2624] Support isExtended for FilteredShowTablesCommand in AuthZ module.
• [KYUUBI #2858] Support skipTests for kyuubi rest client module
• [KYUUBI #2848] Global temp view should only exist in session catalog
• [KYUUBI #2849] Close the engine alive pool gracefully
• [KYUUBI #2851] Log session name when opening/closing session
• [KYUUBI #2247] Change log4j2 properties to xml
• [KYUUBI #2704] verify TPC-DS query output
• [KYUUBI #2846] Add v1.5.2-incubating changelog
• [KYUUBI #2842] [TEST] Optimize the output of ExceptionThrowingDelegationTokenProvider in the Test
• [KYUUBI #2829] Make secret id static and remove thrift protocol from RPC handles
• [KYUUBI #2820] [FOLLOWUP] Fix duplicate SPNEGO typo
• [KYUUBI #2839] Refactor changelog
• [KYUUBI #2781] Fix KyuubiDataSource#getConnection to set user and password
• [KYUUBI #2845] [GA] Stop daily publish on branch-1.3
• [KYUUBI #2805] Add TPC-H queries verification
• [KYUUBI #2837] [BUILD] Support publish to private repo
• [KYUUBI #2820] [SUBTASK][KPIP-4] Support to redirect getLocalLog and closeBatchSession requests across kyuubi instances
• [KYUUBI #2830] Imporve Z-Order with Spark3.3
• [KYUUBI #2746] [INFRA] Improve NOTICE of binary release
• [KYUUBI #2825] [BUILD] Remove kyuubi-flink-sql-engine from kyuubi-server dependencies
• [KYUUBI #2211] [IMPROVEMENT] Add CHANGELOG.md to codebase for maintaining release notes
• [KYUUBI #2643] [FOLLOWUP] Using javax AuthenticationException instead of hadoop AuthenticationException
• [KYUUBI #2373] [SUBTASK][KPIP-4] Support to recovery batch session on Kyuubi instances restart
• [KYUUBI #2824] [TEST] Replace test tag ExtendedSQLTest by Slow
• [KYUUBI #2822] [GA] Set log level to info
• [KYUUBI #2817] Bump Spark 3.3.0-rc5
• [KYUUBI #2676] Flaky Test: SparkOperationProgressSuite: test operation progress
• [KYUUBI #2812] [SUBTASK][KPIP-4] Refine the batch info response
• [KYUUBI #2469] Support RangerDefaultAuditHandler for AuthZ module
• [KYUUBI #2807] Trino, Hive and JDBC Engine support session conf in newExecuteStatementOperation
• [KYUUBI #2814] Set JAVA_HOME in travis via javac
• [KYUUBI #2804] Add flaky test report template
• [KYUUBI #2800] [FOLLOWUP] Return CloseBatchReponse for kyuubi rest client deleteBatch
• [KYUUBI #2800] Refine batch mode code path
• [KYUUBI #2802] Retry opening the TSocket in KyuubiSyncThriftClient
• [KYUUBI #2742] Introduce admin resource for service admin - refresh frontend hadoop conf without restart
• [KYUUBI #2794] Change KyuubiRestException to extend RuntimeException
• [KYUUBI #2793] [DOCS] Add debugging engine
• [KYUUBI #2788] Add excludeDatabases for TPC-H catalogs
• [KYUUBI #2780] Refine stylecheck
• [KYUUBI #2789] Kyuubi Spark TPC-H Connector - Add tiny scale
• [KYUUBI #2765] [SUBTASK][KPIP-4] Refactor current kyuubi-ctl
• [KYUUBI #2717] [FOLLOWUP] Fix BatchRestApiSuite due to jdbc state store UPPER the batch type
• [KYUUBI #2717] [SUBTASK][KPIP-4] Introduce jdbc session state store for batch session multiple HA
• [KYUUBI #2643] [FOLLOWUP] Generate spnego auth token dynamically per request
• [KYUUBI #2741] Add kyuubi-spark-connector-common module
• [KYUUBI #2775] Add excludeDatabases for TPC-DS catalogs
• [KYUUBI #2643] [FOLLOWUP] Refine the rest sdk
• [KYUUBI #2553] Kyuubi Spark TPC-DS Connector - Add tiny scale
• [KYUUBI #2772] Kyuubi Spark TPC-H Connector - use log4j1
• [KYUUBI #2643] [SUBTASK][KPIP-4] Implement kyuubi rest sdk for batch job operation
• [KYUUBI #2763] Expected error code for invalid basic/spnego authentication should be SC_FORBIDDEN
• [KYUUBI #2768] Use the default DB passed in by session in Flink
• [KYUUBI #2764] [DOCS] Fix tables in docs being coverd by right toc sidebar
• [KYUUBI #2760] Add adapter layer in Kyuubi Hive JDBC module
• [KYUUBI #2751] [DOC] Replace sphinx_rtd_theme with sphinx_book_theme
• [KYUUBI #2754] [GA] Separate log archive name
• [KYUUBI #2755] [SUBTASK] DorisSQLEngine - add jdbc label
• [KYUUBI #2752] Kyuubi Spark TPC-DS Connector - configurable catalog’s name by initialize method
• [KYUUBI #2721] Implement dedicated set/get catalog/database operators
• [KYUUBI #2664] Kyuubi Spark TPC-H Connector - SupportsReportStatistics
• [KYUUBI #2471] [FOLLOWUP] Remove unexpected test-function.jar
• [KYUUBI #2743] colorfully kyuubi logo support
• [KYUUBI #2736] Upgrade Jackson 2.13.3
• [KYUUBI #2735] Test Spark 3.3.0-rc3
• [KYUUBI #2665] Kyuubi Spark TPC-H Connector - SupportsNamespaces
• [KYUUBI #2543] Add TPCDSTable generate benchmark
• [KYUUBI #2658] [SUBTASK] DorisSQLEngine with execute statement support
• [KYUUBI #2730] [WIP][KYUUBI #2238] Support Flink 1.15
• [KYUUBI #2663] Kyuubi Spark TPC-H Connector - Initial implementation
• [KYUUBI #2631] Rename high availability config key to support multi discovery client
• [KYUUBI #2733] [CI] Cross version verification for spark-3.3
• [KYUUBI #2285] trino’s result fetching method is changed to a streaming iterator mode to avoid hold data at server side
• [KYUUBI #2718] [KYUUBI#2405] Support Flink StringData Data Type
• [KYUUBI #2719] [SUBTASK][KPIP-4] Support internal rest request authentication to enable http request redirection across kyuubi instances
• [KYUUBI #2720] Fix KyuubiDatabaseMetaData#supportsCatalogs*
• [KYUUBI #2706] Spark extensions support Spark-3.3
• [KYUUBI #2714] Log4j2 layout pattern add date
• [KYUUBI #2686] [FOLLOWUP] Avoid potential flaky test
• [KYUUBI #2594] [FOLLOWUP] Fix flaky Test - support engine alive probe to fast fail on engine broken
• [KYUUBI #2701] Kyuubi Spark TPC-DS Connector - Rework SupportsReportStatistics and code refactor
• [KYUUBI #2712] Bump Spark master to 3.4.0-SNAPSHOT
• [KYUUBI #2541] Set nullable in table schema
• [KYUUBI #2709] Improve TPCDSTable display in Spark Web UI
• [KYUUBI #2619] Add profile spark-3.3
• [KYUUBI #2702] Fix TPC-DS columns name and add TPC-DS queries verification
• [KYUUBI #2348] Add it test for trino engine
• [KYUUBI #2686] Fix lock bug if engine initialization timeout
• [KYUUBI #2690] Make ProcessBuilder.commands immutable
• [KYUUBI #2696] [TEST] Stop NoopServer should not throw exception
• [KYUUBI #2700] Handle SPARK-37929 breaking change in TPCDSCatalog
• [KYUUBI #2683] Add INFO log in ServiceDiscovery.stopGracefully
• [KYUUBI #2694] EngineEvent.toString outputs application tags
• [KYUUBI #2594] Fix flaky Test - support engine alive probe to fast fail on engine broken
• [KYUUBI #2668] [FOLLOWUP] Remove unused Option because the collection is never null
• [KYUUBI #2675] Fix compatibility for spark authz with spark v3.3
• [KYUUBI #2680] Remove SwaggerScalaModelConverter after rest dto classes rewritten in Java
• [KYUUBI #2642] Fix flaky test - JpsApplicationOperation with spark local mode
• [KYUUBI #2668] [SUBTASK][KPIP-4] Rewrite the rest DTO classes in java
• [KYUUBI #2670] Delete the useless judgment in the extractURLComponents method of Utils.java
• [KYUUBI #2672] Check if the table exists
• [KYUUBI #2641] Client should not assume launch engine has completed on exception
• [KYUUBI #2666] Backport HIVE-24694 to Kyuubi Hive JDBC
• [KYUUBI #2661] [SUBTASK][KPIP-4] Rename GET /batches/$batchId/log to GET /batches/$batchId/localLog
• [KYUUBI #2650] Add FilteredShowColumnsCommand to AuthZ module
• [KYUUBI #2576] [FOLLOWUP] Bump Hudi 0.11.0
• [KYUUBI #2540] Kyuubi Spark TPC-DS Connector - SupportsNamespaces
• [KYUUBI #2655] Using the defined app keys for JpsApplicationOperation
• [KYUUBI #2640] Implement TGetInfoType CLI_ODBC_KEYWORDS
• [KYUUBI #2601] Add a config to support different service discovery client class implementation
• [KYUUBI #2471] Fix the bug of dynamically loading external packages
• [KYUUBI #2636] Refine BatchesResourceSuite
• [KYUUBI #2634] [SUBTASK][KPIP-4] Enhance the response error msg
• [KYUUBI #2616] Remove embedded mode support in Kyuubi Hive JDBC driver
• [KYUUBI #2605] Make SQLOperationListener configurable
• [KYUUBI #2474] [IMPROVEMENT] Add FilteredShowFunctionsCommand to Authz module
• [KYUUBI #2604] Hive Backend Engine - Multi tenancy support
• [KYUUBI #2576] Bump Hudi 0.11.0
• [KYUUBI #2473] [FOLLOWUP] Simplify FilteredShowNamespaceExec
• [KYUUBI #2621] Always use Hadoop shaded client
• [KYUUBI #2615] Add support HIVE_CLI_SERVICE_PROTOCOL_V11
• [KYUUBI #2473] [IMPROVEMENT] Add FilteredShowDatabasesCommand to AuthZ module
• [KYUUBI #2626] Replace literal by FetchType.LOG
• [KYUUBI #2614] Add commons-io to beeline module since jdbc upgraded to 3.1.3
• [KYUUBI #2539] [SUBTASK] Kyuubi Spark TPC-DS Connector - SupportsReportStatistics
• [KYUUBI #2591] Redact secret information from ProcBuilder log
• [KYUUBI #2542] [SUBTASK] Kyuubi Spark TPC-DS Connector - Make useAnsiStringType configurable
• [KYUUBI #2607] Introduce new module and setup testcontainers-based Kudu service for testing
• [KYUUBI #2333] Configuring Flink Engine heap memory and java opts
• [KYUUBI #2029] Hive Backend Engine - Operation Logs
• [KYUUBI #2609] Set Kyuubi server thrift client socket timeout to inf
• [KYUUBI #2560] Upgrade kyuubi-hive-jdbc hive version to 3.1.3
• [KYUUBI #2602] Bump testcontainers-scala 0.40.7
• [KYUUBI #2565] Variable substitution should work in plan only mode
• [KYUUBI #2493] [FOLLOWUP] Fix the exception that occurred when beeline rendered spark progress
• [KYUUBI #2378] Implement BatchesResource GET /batches/${batchId}/log
• [KYUUBI #2599] Bump scala-maven-plugin 4.6.1
• [KYUUBI #2493] Implement the progress of statement for spark sql engine
• [KYUUBI #2375] [FOLLOWUP] Implement BatchesResource GET /batches
• [KYUUBI #2588] Reformat kyuubi-hive-sql-engine/pom.xml
• [KYUUBI #2558] Fix warn message
• [KYUUBI #2427] [FOLLOWUP] Flaky test: deregister when meeting specified exception
• [KYUUBI #2582] Minimize Travis build and test
• [KYUUBI #2500] [FOLLOWUP] Resolve flink conf at engine side
• [KYUUBI #2571] Minimize YARN tests overhead
• [KYUUBI #2573] [KPIP-4][SUBTASK] Add a seekable buffered reader for random access operation log
• [KYUUBI #2375] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches
• [KYUUBI #2571] Release connection to prevent the engine leak
• [KYUUBI #2522] Even the process exit code is zero, also check the application state from resource manager
• [KYUUBI #2569] Change the acquisition method of flinkHome to keep it consistent with other engines
• [KYUUBI #2550] Fix swagger does not show the request/response schema issue
• [KYUUBI #2500] Command OptionParser for launching Flink Backend Engine
• [KYUUBI #2379] [SUBTASK][KPIP-4] Implement BatchesResource DELETE /batches/${batchId}
• [KYUUBI #2513] Support NULL type in trino engine and add QueryTests
• [KYUUBI #2403] [IMPROVEMENT] move addTimeoutMonitor to AbstractOperation because it was used in multiple engines
• [KYUUBI #2531] [SUBTASK] Kyuubi Spark TPC-DS Connector - Initial implementation
• [KYUUBI #2523] Flaky Test: KyuubiBatchYarnClusterSuite - open batch session
• [KYUUBI #2376] [SUBTASK][KPIP-4] Implement BatchesResource GET /batches/${batchId}
• [KYUUBI #2547] Support jdbc url prefix jdbc:kyuubi://
• [KYUUBI #2549] Do not auth the request to load OpenApiConf
• [KYUUBI #2548] Prevent dead loop if the batch job submission process it not alive
• [KYUUBI #2533] Make Utils.parseURL public to remove unnecessary reflection
• [KYUUBI #2524] [DOCS] Update metrics.md
• [KYUUBI #2532] Avoid NPE in KyuubiHiveDriver.acceptsURL
• [KYUUBI #2478] [FOLLOWUP] Invoke getOpts method instead of Reflection
• [KYUUBI #2490] [FOLLOWUP] Fix and move set command test case
• [KYUUBI #2517] Rename ZorderSqlAstBuilder to KyuubiSparkSQLAstBuilder
• [KYUUBI #2025] [HIVE] Add a Hive on Yarn doc
• [KYUUBI #2032] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - SetClientInfo
• [KYUUBI #2490] Fix NPE in getOperationStatus
• [KYUUBI #2516] [DOCS] Add Contributor over time in README.md
• [KYUUBI #2346] [IMPROVEMENT] Simplify FlinkProcessBuilder with java executable
• [KYUUBI #2472] Support FilteredShowTablesCommand for AuthZ module
• [KYUUBI #2309] [SUBTASK][KPIP-4] Implement BatchesResource POST /batches
• [KYUUBI #2028] [FOLLOWUP] add engine stop event and fix the partition of initialized event
• [KYUUBI #2512] Fix broken link of IntelliJ IDEA Setup Guide
• [KYUUBI #2450] [FOLLOWUP] Remove opHandle from opHandleSet when exception occurs
• [KYUUBI #2510] Fix NPE when invoking YarnApplicationOperation::getApplicationInfoByTag
• [KYUUBI #2496] Prevent empty auth user when anonymous is allowed
• [KYUUBI #2498] Upgrade Delta version to 1.2.1
• [KYUUBI #2419] Release engine during closing kyuubi server session if share level is connection
• [KYUUBI #2487] Fix test command to make it runnable
• [KYUUBI #2457] Fix flaky test: engine log truncation
• [KYUUBI #2478] Backport HIVE-19018 to Kyuubi Beeline
• [KYUUBI #2020] [SUBTASK] Hive Backend Engine - new APIs with hive-service-rpc 3.1.2 - TGetQueryId
• [KYUUBI #2484] Add conf to SessionEvent and display it in EngineSessionPage
• [KYUUBI #2433] HiveSQLEngine load required jars from HIVE_HADOOP_CLASSPATH
• [KYUUBI #2477] Change state early on stopping
• [KYUUBI #2451] Support isWrapperFor and unwrap
• [KYUUBI #2453] [IMPROVEMENT] checkValue of TypedConfigBuilder shall also print the config name
• [KYUUBI #2427] Flaky test: deregister when meeting specified exception
• [KYUUBI #2456] Supports managing engines of different share level in kyuubi-ctl
• [KYUUBI #1987] Support preserve user context in group/server share level
• [KYUUBI #2467] Remove close launchEngineOp
• [KYUUBI #2440] [IMPROVEMENT] spark engine event add endTime when it is stopped
• [KYUUBI #2461] Use the original host argument
• [KYUUBI #2463] Redact kyuubi.ha.zookeeper.auth.digest in Spark engine
• [KYUUBI #2445] Implement ApplicationManager and Yarn/ JPS-local Application Operation
• [KYUUBI #1936] [FOLLOWUP] Stop updating credentials when credentials are expired
• [KYUUBI #2450] Update lastAccessTime in getStatus and add opHandle to opHandleSet before run
• [KYUUBI #2439] Using Pure Java TPC-DS generator
• [KYUUBI #2448] Log the engine id when opening Kyuubi connection
• [KYUUBI #2436] Add AlterTableRecoverPartitionsCommand for Spark Sql Authz PrivilegesBuilder
• [KYUUBI #2432] [DOCS] button “Download” is invalid
• [[KYUUBI #2429] KYUUBI #2416] Increase Test Coverage For Privileges Builder](https://github.com/apache/incubator-kyuubi/commit/14f675d2)
• [KYUUBI #2344] [IMPROVEMENT] Add Kyuubi Server on Kubernetes with Spark Cluster mode integration test
• [KYUUBI #2201] Show ExecutionId when running status on query engine page
• [KYUUBI #2424] [IMPROVEMENT] add Flink compile version and Trino client compile version to KyuubiServer Log
• [KYUUBI #2253] [IMPROVEMENT] Trino Engine - Events support
• [KYUUBI #2426] Return complete error stack trace information
• [KYUUBI #2410] [IMPROVEMENT] Fix docker-image-tool.sh example version to 1.4.0
• [KYUUBI #2351] Fix Hive Engine terminating blocked by non-daemon threads
• [KYUUBI #2422] Wrap close session with try-finally
• [KYUUBI #2420] Fix outdate .gitignore for dependency-reduced-pom.xml
• [KYUUBI #2368] [IMPROVEMENT] Command OptionParser for launching Trino Backend Engine
• [KYUUBI #2021] [FOLLOWUP] Move derby workaround to test code
• [KYUUBI #2301] Limit the maximum number of concurrent connections per user and ipaddress
• [KYUUBI #2323] Separate events to a submodule - kyuubi-event
• [KYUUBI #2289] Use unique tag to kill applications
• [KYUUBI #2021] Command OptionParser for launching Hive Backend Engine
• [KYUUBI #2414] [KYUUBI apache#2413 ] Fix InsertIntoHiveTableCommand case in PrivilegesBuilder#buildCommand()
• [KYUUBI #2406] Add Flink environments to template
• [KYUUBI #2355] Bump Delta Lake 1.2.0
• [KYUUBI #2349] [DOCS] Usage docs for kyuubi-ctl
• [KYUUBI #2381] [Test] Add Kyuubi on k8s With Spark on k8s client deploy-mode unit test
• [KYUUBI #2390] RuleEliminateMarker stays in analyze phase for data masking
• [KYUUBI #2395] [DOC] Add Documentation for Spark AuthZ Extension
• [KYUUBI #2397] Supports managing engines of different versions in kyuubi-ctl
• [KYUUBI #2402] [IMPROVEMENT] addTimeoutMonitor for trino engine when it run query async
• [KYUUBI #2360] [SUBTASK] Configuring Hive engine heap memory and java opts
• [KYUUBI #2399] Fix PrivilegesBuilder Build Wrong PrivilegeObjets When Query Without Project But With OrderBy/PartitionBy
• [KYUUBI #2308] [SUBTASK][KPIP-4] Batch job configuration ignore list and pre-defined configuration in server-side
• [KYUUBI #2369] [IMPROVEMENT] update developer.md to describe what append descriptions of new configurations to settings.md
• [KYUUBI #2391] Fix privileges builder return wrong result when there is no project but has filter/join
• [KYUUBI #2361] [IMPROVEMENT] Configuring Trino Engine heap memory and java opts
• [KYUUBI #2338] [DOCS] Upgrade sphinx dependencies for documentation build
• [KYUUBI #2385] Export JAVA_HOME. It seems TravisCI stopped doing it recently
• [KYUUBI #2353] [SUBTASK][KPIP-4] Implement BatchJobSubmission operation and basic KyuubiBatchSessionImpl
• [KYUUBI #2359] [Test] Build WithKyuubiServerOnKuberntes
• [KYUUBI #2330] [SUBTASK] Hive Backend Engine - GetTypeInfo Operation
• [KYUUBI #2257] Replace replace conf vars with strings in HiveSQLEngine
• [KYUUBI #2248] [DOCS] Add a flink on yarn kerberos doc
• [KYUUBI #1451] Support Data Column Masking
• [KYUUBI #2357] [IMPROVEMENT] Add warn log and check in class of HiveProcessBuilder
• [KYUUBI #2328] Support getting mainResource in the module target directory of KYUUBI_HOME
• [KYUUBI #2354] Fix NPE in process builder log capture thread
• [KYUUBI #2337] [DOCS] Access Kyuubi with Kyuubi JDBC Driver
• [KYUUBI #2331] Add createSession method to further abstract openSession
• [KYUUBI #2347] Output trino query id within query execute
• [KYUUBI #2345] [DOC] Hot Upgrade Kyuubi Server
• [KYUUBI #2336] Simplify TrinoProcessBuilder with java executable
• [KYUUBI #2343] [KYUUBI#2297] HiveEngineEvent toString is not pretty
• [KYUUBI #1989] Decouple curator from other modules
• [KYUUBI #2324] [SUBTASK][KPIP-4] Implement SparkBatchProcessBuilder to submit spark batch job
• [KYUUBI #2329] [KYUUBI#2214][FOLLOWUP] Cleanup kubernetes-deployment-it
• [KYUUBI #2216] [Test] [K8s] Add Spark Cluster mode on Kubernetes integration test
• [KYUUBI #2024] [FOLLOWUP] Hive Backend Engine - ProcBuilder for HiveEngine
• [KYUUBI #2281] The RenewDelegationToken method of TFrontendService should return SUCCESS_STATUS by default
• [KYUUBI #2300] Add http UGIAssuming handler wrapper for kerberos enabled restful frontend service
• [KYUUBI #2292] [FOLLOWUP] Unify kyuubi server plugin location
• [KYUUBI #2320] Make the CodeSource location correctly obtained on Windows
• [KYUUBI #2316] [DOCS] Fix typo in GitHub issue template
• [KYUUBI #2317] [BUILD] Bump hive-service-rpc 3.1.3 version
• [KYUUBI #2311] Refine github label
• [KYUUBI #2310] Make ranger extension work with mac m1
• [KYUUBI #2312] Spark data type TimestampNTZ supported version changes as 3.4.0
• [KYUUBI #2296] Fix operation log file handler leak
• [KYUUBI #2250] Support to limit the spark engine max running time
• [KYUUBI #2299] Fix flaky test: support engine alive probe to fast fail on engine broken
• [KYUUBI #2292] Unify kyuubi server plugin location
• [KYUUBI #2292] Unify spark extension location
• [KYUUBI #2084] [FOLLOWUP] Support arbitrary parameters for KyuubiConf
• [KYUUBI #2287] Revamp Flink IT by random port and merge tests
• [KYUUBI #1451] Add Row-level filtering support
• [KYUUBI #2280] [INFRA] Replace BSD 3-clause with ASF License v2 for scala binaries
• [KYUUBI #2277] Inline kyuubi prefix in KyuubiConf
• [KYUUBI #2266] The default value of frontend.connection.url.use.hostname should be set to true to be consistent with previous versions
• [KYUUBI #2260] The running query will not update the duration of the page
• [KYUUBI #2272] Fix incorrect doc link
• [KYUUBI #2268] Flaky test: submit spark app timeout with last log output
• [KYUUBI #2275] [DOCS] Fix missing prefix in trino engine quick start
• [KYUUBI #2243] [DOCS] Add quick start for trino engine
• [KYUUBI #2255] The engine state of Spark’s EngineEvent is hardcoded with 0
• [KYUUBI #2263] [KYUUBI #2262]Kyuubi Spark Nightly failed - select timestamp_ntz *** FAILED ***
• [KYUUBI #2209] Add detail usage documents of Flink engine
• [KYUUBI #2246] [BUILD] Pick Commons-Logging dependence out of Hudi-Common
• [KYUUBI #2028] Hive Backend Engine - Events support
• [KYUUBI #2207] Fix DayTimeIntervalType/YearMonthIntervalType Column Size
• [KYUUBI #1451] Introduce Kyuubi Spark AuthZ Module with column-level fine-grained authorization
• [KYUUBI #1798] Add EventBus module to unify the distribution and subscription of Kyuubi’s events
• [KYUUBI #2207] Support newly added spark data types: TimestampNTZType
• [KYUUBI #1021] Expire CredentialsRef in a proper time to reduce memor…
• [KYUUBI #2241] Remove unused deployment documents of Spark
• [KYUUBI #2244] load-kyuubi-env.sh should print SPARK_ENGINE_HOME for consistent
• [KYUUBI #2023] Hive Backend Engine - Shade HiveSQLEngine runtime
• [KYUUBI #1498] Support operation log for ExecuteScala
• [KYUUBI #2087] Add issue template for documentation improvement
• [KYUUBI #1962] Add timeout check for createSpark
• [KYUUBI #2218] Fix maven options about hive-provided
• [KYUUBI #2225] Support to set result max rows for spark engine
• [KYUUBI #2008] [FOLLOWUP] Support engine type and subdomain in kyuubi-ctl
• [KYUUBI #2231] Close action and default sparksession before createSpark.
• [KYUUBI #2222] Refactor the log when failing to get hadoop fs delegation token
• [KYUUBI #2227] Fix operation log dir not deleted issue
• [KYUUBI #2223] Return the last rows of log for prompts even exception detected
• [KYUUBI #2221] Shade hive-service-rpc and thrift in Spark engine
• [KYUUBI #2102] Support to retry the internal thrift request call and add engine liveness probe to enable fast fail before retry
• [KYUUBI #2207] Support newly added spark data types: DayTimeIntervalType/YearMonthIntervalType
• [KYUUBI #2085] [FOLLOWUP] Fix kyuubi-common wrong label
• [KYUUBI #2208] Fixed session close operator log session dir not deleted
• [KYUUBI #2214] Add Spark Engine on Kubernetes integration test
• [KYUUBI #2203] [FLINK] Support flink conf set by kyuubi conf file
• [KYUUBI #2197] [BUILD] Bump jersey 2.35 version
• [KYUUBI #2204] Make comments consistent with code in EngineRef
• [KYUUBI #2186] Manage test failures with kyuubi spark nightly build - execute statement - select interval
• [KYUUBI #2195] Using while-loop or for-loop instead of map/range to improve performance in RowSet
• [KYUUBI #2033] Hive Backend Engine - GetCrossReference
• [KYUUBI #2135] Build and test all modules on Linux ARM64
• [KYUUBI #2035] Hive Backend Engine - build/dist support
• [KYUUBI #2189] Manage test failures with kyuubi spark nightly build - deregister when meeting specified exception *** FAILED ***
• [KYUUBI #2119] [FOLLOWUP] Support output progress bar in Spark engine
• [KYUUBI #2187] Manage test failures with kyuubi spark nightly build - execute simple scala code *** FAILED ***
• [KYUUBI #2184] Manage test failures with kyuubi spark nightly build - operation listener *** FAILED ***
• [KYUUBI #2034] Hive Backend Engine - GetPrimaryKeys
• [KYUUBI #2163] [K8s] copy beeline-jars into docker image
• [KYUUBI #2175] Improve CI with cancel & concurrency & paths filter
• [KYUUBI #2172] [BUILD] Bump Flink 1.14.4 version
• [KYUUBI #2159] [FLINK] Prevent loss of exception message line separator
• [KYUUBI #2024] Hive Backend Engine - ProcBuilder for HiveEngine
• [KYUUBI #2017] Hive Backend Engine - GetColumns Operation
• [KYUUBI #2019] Hive Backend Engine - GetTableTypes Operation
• [KYUUBI #2018] Hive Backend Engine - GetFunctions Operation
• [KYUUBI #2156] [FOLLOWUP] Fix configuration format in document
• [KYUUBI #2119] Support output progress bar in Spark engine
• [KYUUBI #2016] Hive Backend Engine - GetTables Operation
• [KYUUBI #2156] Change log to reflect exactly why getting token failed
• [KYUUBI #2148] [DOCS] Add dev/reformat usage
• [KYUUBI #2150] [DOCS] Fix Getting Started With Kyuubi on Kubernetes
• [KYUUBI #2143] [KYUBBI #2142][DOCS] Add IDEA setup guide
• [KYUUBI #2015] Hive Backend Engine - GetSchemas Operation
• [KYUUBI #1936] [FOLLOWUP] Send credentials when opening session and wait for completion
• [KYUUBI #2085] [FOLLOWUP] Fix the wrong path of module:hive
• [KYUUBI #2134] Respect Spark bundled log4j in extension modules
• [KYUUBI #2014] Hive Backend Engine - GetCatalog Operation
• [KYUUBI #2129] FlinkEngine throws UnsupportedOperationException in GetColumns
• [KYUUBI #2022] Hive Backend Engine - maven-google-downloader plugin support for hive distribution
• [KYUUBI #2084] Support arbitrary parameters for KyuubiConf
• [KYUUBI #2112] Improve the compatibility of queryTimeout in more version clients
• [KYUUBI #2115] Update license and enhance collect_licenses script
• [KYUUBI #2085] Add a labeler github action to triage PRs
• [KYUUBI #1866] [FOLLOWUP] Add Deploy Kyuubi Flink engine on Yarn
• [KYUUBI #2120] Optimize RenewDelegationToken logs in Spark engine
• [KYUUBI #2104] Kill yarn job using yarn client API when kyuubi engine …
• [KYUUBI #2118] [SUBTASK][KPIP-2] Support session jars management
• [KYUUBI #2127] avoid to set HA_ZK_NAMESPACE and HA_ZK_ENGINE_REF_ID repetitively when create flink sql engine
• [KYUUBI #2123] Output engine information after openEngineSession call fails
• [KYUUBI #2125] closeSession should avoid sending RPC after openSession fails
• [KYUUBI #2116] move toString() to ProcBuilder trait from its implements
• [KYUUBI #1866] [FOLLOWUP] Add logging of Flink SQL Engine
• [KYUUBI #1866] [DOCS] Add flink sql engine quick start
• [KYUUBI #2108] Add description about trino in the config of engine.type
• [KYUUBI #2071] Using while-loop instead of map/range to improve performance in RowSet
• [KYUUBI #2070] [FLINK] Support Flink job submission on yarn-session mode
• [KYUUBI #2089] Add debugging instructions for Flink engine
• [KYUUBI #2097] [CI] Upload Test Log for CI failure shall contain trino engine log #2094
• [KYUUBI #2095] Remove useless logic about add conf when create a new engine
• [KYUUBI #1948] [FOLLOWUP] Relocate fb303 classes
• [KYUUBI #1978] Support NEGOTIATE/BASIC authorization for restful frontend service
• [KYUUBI #2081] YARN_CONF_DIR shall be added to kyuubi server classpath as HADOOP_CONF_DIR
• [KYUUBI #2078] logCaptureThread does not catch sparksubmit exception
• [KYUUBI #1936] Send credentials when opening session and wait for completion
• [KYUUBI #2079] Update kyuubi layer source file to add flink and trino…
• [KYUUBI #1563] Fix broken link and add new link in CONTRIBUTION.md
• [KYUUBI #2072] Improve rest server behavior
• [KYUUBI #2075] Using thread-safe FastDateFormat instead of SimpleDateFormat
• [KYUUBI #2066] Fix spelling mistake and appropriate naming
• [KYUUBI #2063] Fix engine idle timeout lose efficacy for Flink Engine
• [KYUUBI #2061] Implementation of the very basic UI on current Jetty server
• [KYUUBI #2011] Introduce to very basic hive engine
• [KYUUBI #1215] [DOC] Document incremental collection
• [KYUUBI #2043] Upgrade log4j/2.x/ to 2.17.2
• [KYUUBI #2060] Clear job group for init SQL
• [KYUUBI #2044] Remove authentication thread local objects to prevent memory leak
• [KYUUBI #1955] Add CI for branch-1.5 & 1.4 SNAPSHOTS
• [KYUUBI #2054] [KYUUBI-1819] Support closing Flink SQL engine process
• [KYUUBI #2055] correct the log service name
• [KYUUBI #2047] Support more MySQL JDBC driver versions

Credits

Last but not least, this release would not have been possible without the following contributors:

• Ada Wong
• BoYang
• Brandon Grams
• Cheng Pan
• Deng An
• Fei Wang
• Fu Chen
• Kent Yao
• Luning Wang
• Mahmoud Bahaa
• Martin Tzvetanov Grigorov
• Min Zhao
• Nick Song
• ParisaTork
• Paul Lin
• Shengkai Fang
• Nicholas Jiang
• Tianlin Liao
• Wang Zhen
• Xiao Zhao
• benjobs
• gabrywu
• guanhua.lgh
• hongdongdong
• jason
• jiadongdong
• jiaoqingbo
• liangbowen
• liaoyt
• liuzy04
• lxorc
• maming
• odone
• packyan
• pengqli
• senmiaoliu
• sychen
• taokelu
• Xiduo You
• wangjunbo
• Zhen Wang
• winfys
• xsun4
• Vino Yang
• yangrong688
• yikf
• zhangliang
• zhangrenhua
• zhanqian
• zhouyifan279
• zwangsheng