StreamNative Weekly Release Notes v2.10.3.4

Download

Distributions

https://github.com/streamnative/pulsar/releases/tag/v2.10.3.4

Packages

Maven Central

Images

sn-platform

General Changes

Apache Pulsar

[fix][security] Fix secure problem CVE-2017-1000487

[cleanup][broker] Validate originalPrincipal earlier in ServerCnx

[fix][broker] Make ServerCnx#originalAuthData volatile

[fix][fn] Fix k8s merge runtime opts bug

[fix][client] Fix async completion in ConsumerImpl#processPossibleToDLQ

[fix][ml] Reset individualDeletedMessagesSerializedSize after acked all messages.

[fix][authorization] Fix the return value of canConsumeAsync

[Improve][broker] Support clear old bookie data for BKCluster

[fix][broker] Remove timestamp from broker metrics

[fix][broker] Fix race condition while updating partition number

[cherry-pick][branch-2.10] Allow superusers to abort transactions

[fix][txn] fix txn coordinator recover handle committing and aborting txn race condition.

[improve][txn] Handle changeToReadyState failure correctly in TC client

[fix] [ml] The atomicity of multiple fields of ml is broken

[fix][ml] Fix potential NPE cause future never complete.

[fix][broker] Fix PulsarRegistrationClient and ZkRegistrationClient not aware rack info problem.

(#12615)) [revert][misc] "modify check waitingForPingResponse with volatile

[cherry-pick][branch-2.10] Close TransactionBuffer when create persistent topic timeout

(#19129)) Revert "[fix][broker] Topic could be in fenced state forever if deletion fails

[fix][broker] Expect msgs after server initiated CloseProducer

[improve][broker] Copy subscription properties during updating the topic partition number.

[improve][broker] Added isActive in ManagedCursorImpl

[fix][txn] Catch and log runtime exceptions in async operations

[fix][broker] Topic could be in fenced state forever if deletion fails

[fix] [ml] Fix the incorrect total size if use ML interceptor

[fix][broker] Support deleting partitioned topics with the keyword -partition-

[improve][client] Change the get lastMessageId to debug level

[fix] [broker] getLastMessageId returns a wrong batch index of last message if enabled read compacted

[fix][misc] do not require encryption on system topics

[fix][broker]fix multi invocation for ledger createComplete

[fix][txn] Correct the prompt message

[fix][broker] Pass subscriptionName to auth service

[fix][broker]optimize the shutdown sequence of broker service when it close

Close TransactionBuffer when MessageDeduplication#checkStatus failed

[fix][io] Update Elasticsearch sink idle cnx timeout to 30s

[fix][proxy] Only go to connecting state once

[fix][client] Set fields earlier for correct ClientCnx initialization

[fix][client] Prevent DNS reverse lookup when physical address is an IP address

KoP

[bugfix] Fix NPE in PendingTopicFutures and fix KafkaMessageOrderTestBase

[cleanup] Remove static LOOKUP_CLIENT_MAP

Extract KafkaTopicLookupManager from KafkaTopicManager to decouple it from Kafka request handling and producer/consumer caching logic

Optimize performance of EncodeResult.updateProducerStats and DecodeResult.updateConsumerStats

[flaky-test] Fix MultiLedgerTest.testListOffsetForEmptyRolloverLedger flaky test

[fix] Make ProducerIdManagerImpl thread safe

[fix] Use thread-safe list in TransactionMarkerChannelManager

Transactions - reduce log level

[improve] Remove partition log when bundle unload

[bugfix] Fix memory leak in case of closed connections with pending requests

[Doc] - Add entryFormat description and performance test class

StreamNative Pulsar Plugins

[rest] Support consumer API manual ack message.

[pulsar-rest] Supports automatic cleaning of idle consumers.

Function Mesh Worker Service

Infer type class name

Support hot-reloading built-in connectors when the config file changes

Lakehouse Connector

[fix][sec] Fix CVEs introduced by log4j 1.2.17