StreamNative Weekly Release Notes v3.2.2.4

Download

Distributions

https://github.com/streamnative/pulsar/releases/tag/v3.2.2.4

Packages

Maven Central

Images

General Changes

Apache Pulsar

[fix] [broker] Fix metrics pulsar_topic_load_failed_count is 0 when load non-persistent topic fails and fix the flaky test testBrokerStatsTopicLoadFailed

[fix][test] Fix the flaky tests of ManagedLedgerImplUtilsTest

[fix][broker] Reader stuck after call hasMessageAvailable when enable replicateSubscriptionState

[fix][test] Flaky-test: ManagedLedgerTest.testTimestampOnWorkingLedger

[improve][broker] Propagate cause exception in TopicBusyException when applicable

[improve][meta] Log a warning when ZK batch fails with connectionloss

[fix][test] Clear fields in test cleanup to reduce memory consumption

[improve][admin] Check if the topic existed before the permission operations

[fix][admin] Fix namespace admin api exception response

[fix][broker] Fix BufferOverflowException and EOFException bugs in /metrics gzip compression

[fix] Include swagger annotations in shaded client lib

[fix][io] CompressionEnabled didn't work on elasticsearch sink

[fix][offload] Increase file upload limit from 2048MiB to 4096MiB for GCP/GCS offloading

[fix][broker] upgrade jclouds 2.5.0 -> 2.6.0

[fix][ml] Fix NPE of getValidPositionAfterSkippedEntries when recovering a terminated managed ledger

[improve][broker] Support X-Forwarded-For and HA Proxy Protocol for resolving original client IP of http/https requests

[fix][broker] Fix broken topic policy implementation compatibility with old pulsar version

[fix][broker] Fix typos in Consumer class

[improve][test] Move ShadowManagedLedgerImplTest to flaky tests

[improve][broker] Repeat the handleMetadataChanges callback when configurationMetadataStore equals localMetadataStore

[improve][broker] Add topic name to emitted error messages.

[improve] Make the config metricsBufferResponse description more effective

[fix][test] SchemaMap in AutoConsumeSchema has been reused

[improve][broker] backlog quota exceed limit log replaced with debug

[fix][broker] Fix message drop record in producer stat

[fix][broker] Update topic partition failed when config maxNumPartitionsPerPartitionedTopic<0

AoP

[fix] Fix AoP can't work when enabling Pulsar transaction

KoP

Fix requiredAcks == 0 handling

Cloud Storage Connector

fix: Read JSON directly from the original data when formatType=json

AMQP1_0 Connector

Fix integration test due to invalid package storage path

AWS SQS Connector

Upgrade commons-compress to fix CVE

fix integrate test.

Update license to proprietary one

StreamNative Pulsar Plugins

[RBAC] Bump RBAC test image to fix compatible problem

[RBAC] Fix test json data

auditlog: perf: create AuditLogEvent instances only when there's a matching rule

Deferred generation id for AuditLogEvent

auditlog: replace rw lock & HashMaps with ConcurrentHashMap to reduce blocking code

auditlog: optimize uri matching by organizing condition and eliminating streams

auditlog: Cache regex compilation

[RBAC] Skip unsupported operations for rbac authorization provider

Google BigQuery Sink Connector

upgrade depend to fix cve

Aws EventBridge Connector

Bump org.apache.avro:avro from 1.10.2 to 1.11.3

StreamNative Tiered storage

Fix complex pojo encode json message error

Use zk lock by default

Fix avro didn't support enum type problem

Transfer schema before acquire lock.

Improve delta compactor