Release Notes - 1.7.2

Highlight

• Enhance JDBC Client and Beeline Client, like: Support running Python scripts and codes in Beeline, fix Http authentication exception message is empty, backport HIVE-19048: Initscript errors are ignored, backport HIVE-15820: comment at the head of beeline -e.
• Enhance submission engine related code, like: support yarn-client and yarn-cluster for YarnApplicationOperation, different engine submit timeout config, destroy build process when waitCompletion is false and engine is running in cluster mode
• Fix many flaky tests and incorrect documentations

Server

• [KYUUBI #4786] Support yarn-client and yarn-cluster for YarnApplicationOperation
• [KYUUBI #4801] Using different engine submit timeout config for kubernetes and yarn
• [KYUUBI #4811] Do not update app info after batch or application terminated
• [KYUUBI #4816] [K8S] Correct the implementation of cleanup terminated appInfo
• [KYUUBI #4830] [TEST] Fix flaky test “support to interrupt the thrift request if remote engine is broken”
• [KYUUBI #4840] Return cached appInfo iif both op and app are terminated
• [KYUUBI #4841] [MINOR] Log more info for closing session
• [KYUUBI #4807] [TEST] Retry more times to fix flaky test “spnego batch rest client”
• [KYUUBI #4807] [FOLLOWUP] Fix flaky test “basic batch rest client”
• [KYUUBI #4855] Change socket “connection refused” message match pattern
• [KYUUBI #4858] Relax test message assertion in “sync query causes engine crash”
• [KYUUBI #4919] Fix the flaky tests in the “open batch session” functionality within the “BatchesResourceSuite”
• [KYUUBI #4876] fix Flaky test BackendServiceMetricSuite
• [KYUUBI #4979] Fix flaky test: support to interrupt the thrift request if remote engine is broken
• [KYUUBI #4977] Log error message when REST API invocation error occurs
• [KYUUBI #4946] Alter the order of initLoggerEventHandler
• [KYUUBI #5072] [TEST] Fix KyuubiOperationWithEngineSecuritySuite and related issues
• [KYUUBI #5043] [1.7] Destroy the build process when waitCompletion is false and the engine is running in cluster mode
• [KYUUBI #3920] [TEST] Fix flaky test - distribute lock
• [KYUUBI #5204] Thrift HTTP FE checks req conf nullable before evaluating proxy user

Spark Engine

• [KYUUBI #4838] Fix spark operation exception leak in withLocalProperties method
• [KYUUBI #4835] [K8S] Using hive conf to check whether to apply HIVE_DELEGATION_TOKEN
• [KYUUBI #4915] Adapt database not exist error message change for Spark 3.4
• [KYUUBI #4952] Enhance AWS Glue default database does not exist error message on opening session
• [KYUUBI #5005] Remove default settings spark.sql.execution.topKSortFallbackThreshold
• [KYUUBI #5025] Use formatDuration instead of formatDurationVerbose in SparkUI’s engine tab
• [KYUUBI #5019] Shows details of compilation info in SparkUI’s engine tab
• [KYUUBI #5045] Initialize EXECUTOR_POD_NAME_PREFIX_MAX_LENGTH before using
• [KYUUBI #5105] [Bug] getColumns gets duplicate column names when Spark integrates with Iceberg
• [KYUUBI #5148] Improve spark.driver.host assignment in Spark on K8s client mode
• [KYUUBI #5232] In SparkOperation#cleanup always calls cancelJobGroup even though it’s in the completed state

Spark Extensions

• [KYUUBI #4995] Use hadoop conf and hive conf from catalog options
• [KYUUBI #5028] Update session hadoop conf to catalog hadoop conf

Client

• [KYUUBI #4859] HttpException message should not be null
• [KYUUBI #4969] [TEST] Run JUnit tests on beeline module
• [KYUUBI #4962] [1.7] Backport HIVE-19048: Initscript errors are ignored
• [KYUUBI #4965] [BEELINE] Support –python-mode option and remove comments for non-python mode
• [KYUUBI #4305] Backport HIVE-15820: comment at the head of beeline -e
• [KYUUBI #5100] [Minor] Fix unpaired quote in message pattern
• [KYUUBI #5101] [MINOR] Remove unused StringBuilders in ResultSets
• [KYUUBI #5129] KyuubiBeeline should redirect JDK logging

Common

• [KYUUBI #4808] Bump Jetty from 9.4.50 to 9.4.51
• [KYUUBI #4836] Set UncaughtExceptionHandler for thread to log exception
• [KYUUBI #4857] Fix flaky test TFrontendServiceSuite
• [KYUUBI #4898] fix logOperation multiple read with missing line
• [KYUUBI #4949] For operation getNextRowSet method, with operation lock required
• [KYUUBI #4951] Add reload4j support
• [KYUUBI #4978] Fix flaky test: close expired operations
• [KYUUBI #4986] Always use Files#deleteIfExists
• [KYUUBI #4978] [FOLLOWUP] Fix flaky test: close expired operations
• [KYUUBI #4985] [TEST] Fix loglevel restore behavior of KyuubiFunSuite#withLogAppender
• [KYUUBI #5036] Fix Operation.close not update complete timestamp
• [KYUUBI #5090] Fix AllKyuubiConfiguration to generate redundant blank lines in Windows
• [KYUUBI #5158] Allow embedded Zookeeper binding IP address
• [KYUUBI #5187] [Minor] Fix info message in UserFilter

Deployment

• [KYUUBI #4818] [K8S] [HELM] Update default Kyuubi version to 1.7.1
• [KYUUBI #4828] [BUILD] Exclude macOS tar extended metadata in build/dist
• [KYUUBI #4851] [BUILD] Bump Maven 3.8.8

Documentation

• [KYUUBI #4864] [DOCS] Fix grammar in HA section
• [KYUUBI #4954] [DOCS] Fix variable reference in quick_start_with_jdbc
• [KYUUBI #4960] [DOC] Fix doc for pyhive client.
• [KYUUBI #5049] [DOCS] PyHive Kerberos usage doc
• [KYUUBI #5085] Update config section of deploy on kubernetes
• [KYUUBI #5094] Add Python JayDeBeApi doc
• [KYUUBI #5099] Document link failure
• [KYUUBI #5083] [DOC] Add LDAP document
• [KYUUBI #5146] [DOC] Fix link of IntelliJ IDEA Setup Guide

Credits

Last but not least, this release would not have been possible without the following contributors:

• BruceWong96
• CavemanIV
• QianyongY
• bowenliang123
• cxzl25
• dev-lpq
• dnskr
• huangzhir
• lightning-L
• liunaijie
• lsm1
• mans2singh
• pan3793
• risyomei
• touchida
• turboFei
• uicosp
• ulysses-you
• wForget
• yaooqinn
• zhaohehuhu
• zhaomin1423