​
StreamNative Weekly Release Notes v4.0.4.2

​
Download

​
Distributions

​
Packages

​
Images

​
General Changes

​
Apache Pulsar

(#24246) [fix][build] Fix errorprone maven profile configuration

(#24243) [improve][build] Upgrade SpotBugs to 4.9.x

(#24239) [improve][misc] Migrate from multiple nullness annotation libraries to JSpecify annotations

(#24240) [improve][build] Upgrade to jacoco 0.8.13

(#24236) [improve] Adapt startup scripts for Java 24 changes

(#24242) [improve][build] Upgrade errorprone to 2.38.0

(#24237) [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24

(#24235) [fix][test] Fix resource leaks in PulsarBrokerStarterTest

(#24221) [improve][io] support kafka connect transforms and predicates

(#24230) [improve][client]Improve transaction log when a TXN command timeout

(#24223) [fix][broker] Orphan schema after disabled a cluster for a namespace

(#24228) [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages

(#24184) [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation

(#24219) [improve][broker]Improve the feature “Optimize subscription seek (cursor reset) by timestamp”: search less entries

(#24214) [improve] Upgrade Netty to 4.1.121.Final

(#24212) [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck

(#24218) [fix][test] Fix multiple resource leaks in tests

(#24187) [improve][client] validate ClientConfigurationData earlier to avoid resource leaks

(#24216) [fix][broker] Fix HealthChecker deadlock in shutdown

(#24209) [fix][broker] Fix tenant creation and update with null value

(#24192) [fix][admin] Backlog quota’s policy is null which causes a NPE

(#24205) [improve] Upgrade Apache Commons library versions to compatible versions

(#24210) [fix][broker] Fix broker shutdown delay by resolving hanging health checks

(#24207) [fix][broker] Fix compaction service log’s wrong condition

(#24204) [fix][test] Fix resource leaks in ProxyTest and fix invalid tests

(#24201) [improve][io] Upgrade Kafka client and compatible Confluent platform version

(#24118))) Revert “[fix][broker] Add topic consistency check

(#24154))) Revert “[fix][broker] Directly query single topic existence when the topic is partitioned

(#24194) [fix][test] Fix flaky NamespacesTest.testNamespacesApiRedirects

(#24196) [fix][broker] Fix NPE from the wrong iterator in the ownership cleanup job(ExtensibleLoadManagerImpl only)

(#24151) [fix][broker] Fix cluster level OffloadedReadPriority to bookkeeper-first does not work

(#24186) [fix][broker] Fixes Inconsistent ServiceUnitStateData View (ExtensibleLoadManagerImpl only)

(#24103) [fix][schema] Reject unsupported Avro schema types during schema registration

(#24181) [fix][proxy] Fix incorrect client error when calling get topic metadata

(#24091) [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups.

(#24174) [fix][test] Fix remaining UnfinishedStubbingException issue with AuthZTests

(#24171) [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext

(#24172) [fix][test] Improve reliability of IncrementPartitionsTest

(#24168) [fix][build] Fix skipTag and use explicit tag for image name

(#24170) [fix][test]flaky-test:ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure

(#23980) [fix][broker] Consumer stuck when delete subscription __compaction failed

(#24167) [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API

(#24166) [fix][test] Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck

(#24165) [fix][test] Fix UnfinishedStubbing issue in AuthZTests

(#24098) [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe

(#24154) [fix][broker] Directly query single topic existence when the topic is partitioned

(#24118) [fix][broker] Add topic consistency check

(#24056) [fix][test] Update partitioned topic subscription assertions in IncrementPartitionsTest

(#24033) [cleanup][misc] Add override annotation

(#24180) [improve][build] Build apachepulsar/pulsar-io-kinesis-sink-kinesis_producer with Alpine 3.21

​
AoP

255d5d8 Add back qpid-test-utils package

​
MoP

(#1731) Fix user properties lost when enable authorization

​
KoP

Support handle DESCRIBE_LOG_DIRS request

​
StreamNative Pulsar Plugins

Fix the time ticker leak issue which caused high CPU usage

[cluster-rollout] add orphan unload job cleanup logic

Update Go SDK rbac & oidc dependencies

Update x/net and go 1.24

Fix jlink command’s compress argument

​
pulsarctl

(#1790) Add release workflow

(#1784) Update to Go 1.24 to avoid CVEs

​
Function Mesh Worker Service

exclude lz4-java for CVE reasons

Unified resource scale for all Objects and make it configurable

​
StreamNative Unified RBAC

Support batch apply role bindings

​
StreamNative Ursa storage

Fix topic quarantine bug

Implement new interface for Pulsar

Add default timeout for all integration tests

External table support wal compact

Disable expire Iceberg snapshot by default

Support fencing a managed ledger after closing

a4a8e721 Fix pom

Use nonRetriableQuaratine for task publish

Improve the compaction worker handle stream task logic.

Flaky test in SimpleStorageImplTest.java

[improve] Use ReentrantReadWriteLock in EntryCache

Move out the integration test containers to a new module

Add metrics for the read cache size in bytes

Fix the NPE when getting the non-exists blob

Fix the aws config socket time not work issue.

Add more netty config

Reduce primitive schema retry times

Format compaction service quarantine logic

Support configure iceberg table properties with topic properties

Throw exception when read empty entries in lakehouse worker.

[fix] throw exception upon EntryCache apis calls after EntryCache is closed

Move the persistStorageApi initialize in the common place

Fix real offset incorrect

Fix semaphore not release bug

Fix read lock not release bug

Fix build failure

GCS supports delete with lifecycle

Throw exceptions when handle the recursive schema

throw exception when hitting non-binary index while processing RAW type

Support azure to delete object using lifecycle rules

Delete the compact task when compaction worker read compacted wal file.

Quarantine topic when get topic failed or get topic metadata failed

​
Security Fixes

​
Apache Pulsar

(#24232) [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763