Release Notes - Kafka - Version 3.1.1

Below is a summary of the JIRA issues addressed in the 3.1.1 release of Kafka. For full documentation of the release, a guide to get started, and information about the project, see the Kafka project site.

Note about upgrades: Please carefully review the upgrade documentation for this release thoroughly before upgrading your cluster. The upgrade notes discuss any critical information about incompatibilities and breaking changes, performance changes, and any other changes that might impact your production deployment of Kafka.

The documentation for the most recent release can be found at https://kafka.apache.org/documentation.html.

Improvement

• [KAFKA-13583] - Fix FetchRequestBetweenDifferentIbpTest flaky tests
• [KAFKA-13585] - Fix `kafka.server.ReplicaManagerTest.testReplicaAlterLogDirsWithAndWithoutIds` flaky test
• [KAFKA-13637] - User default.api.timeout.ms config as default timeout for KafkaConsumer.endOffsets
• [KAFKA-13673] - disable idempotent producer when acks/retries/max.in.flight config conflicts
• [KAFKA-13752] - Using `equals` instead of `==` when Uuid compare in Java

Bug

• [KAFKA-8659] - SetSchemaMetadata SMT fails on records with null value and schema
• [KAFKA-12879] - Compatibility break in Admin.listOffsets()
• [KAFKA-13388] - Kafka Producer nodes stuck in CHECKING_API_VERSIONS
• [KAFKA-13412] - Retry of initTransactions after timeout may cause invalid transition
• [KAFKA-13418] - Brokers disconnect intermittently with TLS1.3
• [KAFKA-13563] - FindCoordinatorFuture never get cleared in non-group mode( consumer#assign)
• [KAFKA-13579] - Upgrade vulnerable dependencies
• [KAFKA-13591] - Fix flaky test ControllerIntegrationTest.testTopicIdCreatedOnUpgrade
• [KAFKA-13598] - idempotence producer is not enabled by default if not set explicitly
• [KAFKA-13636] - Committed offsets could be deleted during a rebalance if a group did not commit for a while
• [KAFKA-13658] - Upgrade vulnerable dependencies jan 2022
• [KAFKA-13660] - Replace log4j with reload4j
• [KAFKA-13661] - KRaft uses the wrong permission for adding topic partitions
• [KAFKA-13719] - connector restart cause duplicate tasks
• [KAFKA-13721] - Left-join still emit spurious results in stream-stream joins in some cases
• [KAFKA-13727] - Edge case in cleaner can result in premature removal of ABORT marker
• [KAFKA-13748] - Do not include file stream connectors in Connect's CLASSPATH and plugin.path by default
• [KAFKA-13750] - Client Compatability KafkaTest uses invalid idempotency configs
• [KAFKA-13759] - Disable producer idempotence by default in producers instantiated by Connect
• [KAFKA-13770] - Regression when Connect uses 0.10.x brokers due to recently added retry logic in KafkaBasedLog
• [KAFKA-13775] - CVE-2020-36518 - Upgrade jackson-databind to 2.12.6.1
• [KAFKA-13782] - Producer may fail to add the correct partition to transaction
• [KAFKA-13794] - Producer batch lost silently in TransactionManager

Test

• [KAFKA-13589] - fix flaky `PlaintextAdminIntegrationTest.testReplicaCanFetchFromLogStartOffsetAfterDeleteRecords` test