StreamNative Weekly Release Notes v3.1.0.5

Download

Distributions

• https://github.com/streamnative/pulsar/releases/tag/v3.1.0.5

Packages

• Maven Central

Images

• sn-platform

General Changes

Apache Pulsar

(#21332) [fix][broker] Fix unload operation stuck when use ExtensibleLoadManager

(#21282) [improve][broker] use ConcurrentHashMap in ServiceUnitStateChannel and avoid recursive update error

(#21327) [fix] [bk-client] Fix bk client MinNumRacksPerWriteQuorum and EnforceMinNumRacksPerWriteQuorum not work problem.

(#21360) [fix][broker] Fix heartbeat namespace create event topic and cannot delete heartbeat topic

(#21348) [fix][broker] Fix heartbeat namespace create transaction internal topic

(#21231) [fix][broker] Fix inconsistent topic policy

(#20944) [fix][broker] rackaware policy is ineffective when delete zk rack info after bkclient initialize

(#21391) [improve][ci] Add new CI unit test group "Broker Group 4" with cluster migration tests

(#21213) (#21314) [fix][broker][branch-3.1] Fix lookup heartbeat and sla namespace bundle when using extensible load manager

(#21378) [fix][test] Fix resource leaks with Pulsar Functions tests

(#21374) [fix][test] Fix some resource leaks in compaction tests

(#21267) [feat][sql] Support UUID for json and avro

(#21366) [fix][test] Fix a resource leak in ClusterMigrationTest

(#21155) [fix] [broker] Make specified producer could override the previous one

(#21365) [fix][ci] Fix docker image building by releasing more disk space before building

(#21255) [fix][broker][branch-3.1] Fix inconsistent topic policy

(#21310) [fix] [metadata] Fix zookeeper related flacky test

(#21340) [improve] [auto-recovery] [branch-3.1] Migrate the replication testing from BookKeeper to Pulsar.

(#21222) [fix] [broker] fix flaky test PatternTopicsConsumerImplTest

(#21338) [fix][sec] Fix MultiRoles token provider when using anonymous clients

(#20939) [fix][broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin

(#21329) [fix][test] Fix flaky CompactionTest.testDispatcherMaxReadSizeBytes

(#21328) [fix][test] Fix flaky test NarUnpackerTest

(#21302) [fix][ml] Fix thread safe issue with RangeCache.put and RangeCache.clear

(#21278) [fix][build] Upgrade Lombok to 1.18.30 to support compiling with JDK21

(#21281) [fix][sec] Add OWASP Dependency Check suppressions

(#21177) [fix][txn] fix the consumer stuck due to deduplicated messages in pending ack state

(#21232) [improve] [client] Merge lookup requests for the same topic

(#21215) [fix][fn] fix functions_log4j2.xml delete strategy config

(#21237) [fix][broker]Fixed produce and consume when anonymousUserRole enabled

(#21225) [fix][broker] Fixed reset for AggregatedNamespaceStats

(#21205) [fix][broker] replicator leak when removeReplicator in NonPersistentTopic

KoP

(#181) Attach Kafka txn_metadata to messageMetadata in KafkaEntryFormatter

(#2007) (#170) [fix] Run messageReadStats metrics registerFailedEvent execute on netty thread

(#180) Ignore metadata init exception to avoid rolling upgrade from failing

(#175) Ignore the flaky MultiLedgerTest.testListOffsetForEmptyRolloverLedger

(#157) Fix txn marker to the offset topic cannot be read

(#160) Support alter cleanup policy

AMQP1_0 Connector

(#721) Improve sink and source connector docs.

pulsarctl

(#1200) (#1203) Support status check for pulsarctl command

StreamNative Pulsar Plugins

(#1313) [audit-log][fix] Fix audit log producer cache

(#1285) Fix passing transactional flag in KafkaCompactionParser

Cloud Pulsar Plugins

(#867) [branch-3.1] Revert Pulsar version and remove useless repo

(#861) [rest-api-interceptor] Ignore system topics for max topic count check

Function Mesh Worker Service

23e78851 Bump function mesh to v0.17.0

(#1054) disable golang runtime by default

(#999) allow submit very long name resources

(#1047) Set usingInsecureAuth to false by default

(#1014) Add configs: javaOpts/labels/logConfig to CustomRuntimeOptions

(#1028) Read connector catalogs from namespaces.

Google BigQuery Sink Connector

(#409) Add dockerfile metadata on source docs.

(#395) Improve source connector docs.

Snowflake Connector

(#247) [fix] Remove the dependency on com.beust.jcommander

(#216) [fix] Fix the tableName configuration is not respected

Aws EventBridge Connector

(#141) [fix] Fix getting wrong metadata value of sequence_id and producer_name