StreamNative Weekly Release Notes v3.1.0.5

Download

Distributions

• https://github.com/streamnative/pulsar/releases/tag/v3.1.0.5

Packages

• Maven Central

Images

• sn-platform

General Changes

Apache Pulsar

[fix][broker] Fix unload operation stuck when use ExtensibleLoadManager

[improve][broker] use ConcurrentHashMap in ServiceUnitStateChannel and avoid recursive update error

[fix] [bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem.

[fix][broker] Fix heartbeat namespace create event topic and cannot delete heartbeat topic

[fix][broker] Fix heartbeat namespace create transaction internal topic

[fix][broker] Fix inconsistent topic policy

[fix][broker] rackaware policy is ineffective when delete zk rack info after bkclient initialize

[improve][ci] Add new CI unit test group "Broker Group 4" with cluster migration tests

[fix][broker][branch-3.1] Fix lookup heartbeat and sla namespace bundle when using extensible load manager

[fix][test] Fix resource leaks with Pulsar Functions tests

[fix][test] Fix some resource leaks in compaction tests

[feat][sql] Support UUID for json and avro

[fix][test] Fix a resource leak in ClusterMigrationTest

[fix] [broker] Make specified producer could override the previous one

[fix][ci] Fix docker image building by releasing more disk space before building

[fix][broker][branch-3.1] Fix inconsistent topic policy

[fix] [metadata] Fix zookeeper related flacky test

[improve] [auto-recovery] [branch-3.1] Migrate the replication testing from BookKeeper to Pulsar.

[fix] [broker] fix flaky test PatternTopicsConsumerImplTest

[fix][sec] Fix MultiRoles token provider when using anonymous clients

[fix][broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin

[fix][test] Fix flaky CompactionTest.testDispatcherMaxReadSizeBytes

[fix][test] Fix flaky test NarUnpackerTest

[fix][ml] Fix thread safe issue with RangeCache.put and RangeCache.clear

[fix][build] Upgrade Lombok to 1.18.30 to support compiling with JDK21

[fix][sec] Add OWASP Dependency Check suppressions

[fix][txn] fix the consumer stuck due to deduplicated messages in pending ack state

[improve] [client] Merge lookup requests for the same topic

[fix][fn] fix functions_log4j2.xml delete strategy config

[fix][broker]Fixed produce and consume when anonymousUserRole enabled

[fix][broker] Fixed reset for AggregatedNamespaceStats

[fix][broker] replicator leak when removeReplicator in NonPersistentTopic

KoP

Attach Kafka txn_metadata to messageMetadata in KafkaEntryFormatter

[fix] Run messageReadStats metrics registerFailedEvent execute on netty thread

Ignore metadata init exception to avoid rolling upgrade from failing

Ignore the flaky MultiLedgerTest.testListOffsetForEmptyRolloverLedger

Fix txn marker to the offset topic cannot be read

Support alter cleanup policy

AMQP1_0 Connector

Improve sink and source connector docs.

pulsarctl

Support status check for pulsarctl command

StreamNative Pulsar Plugins

[audit-log][fix] Fix audit log producer cache

Fix passing transactional flag in KafkaCompactionParser

Cloud Pulsar Plugins

[branch-3.1] Revert Pulsar version and remove useless repo

[rest-api-interceptor] Ignore system topics for max topic count check

Function Mesh Worker Service

23e78851 Bump function mesh to v0.17.0

disable golang runtime by default

allow submit very long name resources

Set usingInsecureAuth to false by default

Add configs: javaOpts/labels/logConfig to CustomRuntimeOptions

Read connector catalogs from namespaces.

Google BigQuery Sink Connector

Add dockerfile metadata on source docs.

Improve source connector docs.

Snowflake Connector

[fix] Remove the dependency on com.beust.jcommander

[fix] Fix the tableName configuration is not respected

Aws EventBridge Connector

[fix] Fix getting wrong metadata value of sequence_id and producer_name