StreamNative Weekly Release Notes v3.2.2.4

Download

Distributions

https://github.com/streamnative/pulsar/releases/tag/v3.2.2.4

Packages

Maven Central

Images

General Changes

Apache Pulsar

(#22580) [fix] [broker] Fix metrics pulsar_topic_load_failed_count is 0 when load non-persistent topic fails and fix the flaky test testBrokerStatsTopicLoadFailed

(#22611) [fix][test] Fix the flaky tests of ManagedLedgerImplUtilsTest

(#22572) [fix][broker] Reader stuck after call hasMessageAvailable when enable replicateSubscriptionState

(#22600) [fix][test] Flaky-test: ManagedLedgerTest.testTimestampOnWorkingLedger

(#22596) [improve][broker] Propagate cause exception in TopicBusyException when applicable

(#22566) [improve][meta] Log a warning when ZK batch fails with connectionloss

(#22583) [fix][test] Clear fields in test cleanup to reduce memory consumption

(#22547) [improve][admin] Check if the topic existed before the permission operations

(#22587) [fix][admin] Fix namespace admin api exception response

(#22576) [fix][broker] Fix BufferOverflowException and EOFException bugs in /metrics gzip compression

(#22570) [fix] Include swagger annotations in shaded client lib

(#22565) [fix][io] CompressionEnabled didn't work on elasticsearch sink

(#22554) [fix][offload] Increase file upload limit from 2048MiB to 4096MiB for GCP/GCS offloading

(#22220) [fix][broker] upgrade jclouds 2.5.0 -> 2.6.0

(#22552) [fix][ml] Fix NPE of getValidPositionAfterSkippedEntries when recovering a terminated managed ledger

(#22524) [improve][broker] Support X-Forwarded-For and HA Proxy Protocol for resolving original client IP of http/https requests

(#22535) [fix][broker] Fix broken topic policy implementation compatibility with old pulsar version

(#22532) [fix][broker] Fix typos in Consumer class

(#22526) [improve][test] Move ShadowManagedLedgerImplTest to flaky tests

(#22519) [improve][broker] Repeat the handleMetadataChanges callback when configurationMetadataStore equals localMetadataStore

(#22506) [improve][broker] Add topic name to emitted error messages.

(#22490) [improve] Make the config metricsBufferResponse description more effective

(#22500) [fix][test] SchemaMap in AutoConsumeSchema has been reused

(#22488) [improve][broker] backlog quota exceed limit log replaced with debug

(#22458) [fix][broker] Fix message drop record in producer stat

(#22397) [fix][broker] Update topic partition failed when config maxNumPartitionsPerPartitionedTopic<0

AoP

(#1070) [fix] Fix AoP can't work when enabling Pulsar transaction

KoP

(#524) Fix requiredAcks == 0 handling

Cloud Storage Connector

(#966) fix: Read JSON directly from the original data when formatType=json

AMQP1_0 Connector

(#898) Fix integration test due to invalid package storage path

AWS SQS Connector

(#920) Upgrade commons-compress to fix CVE

(#921) fix integrate test.

(#902) Update license to proprietary one

StreamNative Pulsar Plugins

(#1669) [RBAC] Bump RBAC test image to fix compatible problem

(#1665) [RBAC] Fix test json data

(#1659) auditlog: perf: create AuditLogEvent instances only when there's a matching rule

(#1658) Deferred generation id for AuditLogEvent

(#1655) auditlog: replace rw lock & HashMaps with ConcurrentHashMap to reduce blocking code

(#1654) auditlog: optimize uri matching by organizing condition and eliminating streams

(#1653) auditlog: Cache regex compilation

(#1652) [RBAC] Skip unsupported operations for rbac authorization provider

Google BigQuery Sink Connector

(#555) upgrade depend to fix cve

Aws EventBridge Connector

(#187) Bump org.apache.avro:avro from 1.10.2 to 1.11.3

StreamNative Tiered storage

(#749) Fix complex pojo encode json message error

(#746) Use zk lock by default

(#747) Fix avro didn't support enum type problem

(#743) Transfer schema before acquire lock.

(#730) Improve delta compactor