Skip to main content

​
StreamNative Weekly Release Notes v4.0.4.2

​
Download

​
Distributions

​
Packages

​
Images

​
General Changes

​
Apache Pulsar

(#24246) [fix][build] Fix errorprone maven profile configuration (#24243) [improve][build] Upgrade SpotBugs to 4.9.x (#24239) [improve][misc] Migrate from multiple nullness annotation libraries to JSpecify annotations (#24240) [improve][build] Upgrade to jacoco 0.8.13 (#24236) [improve] Adapt startup scripts for Java 24 changes (#24242) [improve][build] Upgrade errorprone to 2.38.0 (#24237) [improve][build] Upgrade Lombok to 1.18.38 to support JDK 24 (#24235) [fix][test] Fix resource leaks in PulsarBrokerStarterTest (#24221) [improve][io] support kafka connect transforms and predicates (#24230) [improve][client]Improve transaction log when a TXN command timeout (#24223) [fix][broker] Orphan schema after disabled a cluster for a namespace (#24228) [fix][broker] Fix ByteBuf memory leak in REST API for publishing messages (#24184) [fix][client] Fix incorrect producer.getPendingQueueSize due to incomplete queue implementation (#24219) [improve][broker]Improve the feature “Optimize subscription seek (cursor reset) by timestamp”: search less entries (#24214) [improve] Upgrade Netty to 4.1.121.Final (#24212) [fix][test] Fix flaky BatchMessageWithBatchIndexLevelTest.testBatchMessageAck (#24218) [fix][test] Fix multiple resource leaks in tests (#24187) [improve][client] validate ClientConfigurationData earlier to avoid resource leaks (#24216) [fix][broker] Fix HealthChecker deadlock in shutdown (#24209) [fix][broker] Fix tenant creation and update with null value (#24192) [fix][admin] Backlog quota’s policy is null which causes a NPE (#24205) [improve] Upgrade Apache Commons library versions to compatible versions (#24210) [fix][broker] Fix broker shutdown delay by resolving hanging health checks (#24207) [fix][broker] Fix compaction service log’s wrong condition (#24204) [fix][test] Fix resource leaks in ProxyTest and fix invalid tests (#24201) [improve][io] Upgrade Kafka client and compatible Confluent platform version (#24118))) Revert “[fix][broker] Add topic consistency check (#24154))) Revert “[fix][broker] Directly query single topic existence when the topic is partitioned (#24194) [fix][test] Fix flaky NamespacesTest.testNamespacesApiRedirects (#24196) [fix][broker] Fix NPE from the wrong iterator in the ownership cleanup job(ExtensibleLoadManagerImpl only) (#24151) [fix][broker] Fix cluster level OffloadedReadPriority to bookkeeper-first does not work (#24186) [fix][broker] Fixes Inconsistent ServiceUnitStateData View (ExtensibleLoadManagerImpl only) (#24103) [fix][schema] Reject unsupported Avro schema types during schema registration (#24181) [fix][proxy] Fix incorrect client error when calling get topic metadata (#24091) [fix][broker] Fix some problems in calculate totalAvailableBookies in method getExcludedBookiesWithIsolationGroups when some bookies belongs to multiple isolation groups. (#24174) [fix][test] Fix remaining UnfinishedStubbingException issue with AuthZTests (#24171) [improve][test] Use configured session timeout for MockZooKeeper and TestZKServer in PulsarTestContext (#24172) [fix][test] Improve reliability of IncrementPartitionsTest (#24168) [fix][build] Fix skipTag and use explicit tag for image name (#24170) [fix][test]flaky-test:ManagedLedgerInterceptorImplTest.testManagedLedgerPayloadInputProcessorFailure (#23980) [fix][broker] Consumer stuck when delete subscription __compaction failed (#24167) [fix][ml] Fix ML thread blocking issue in internalGetPartitionedStats API (#24166) [fix][test] Fix invalid test CompactionTest.testDeleteCompactedLedgerWithSlowAck (#24165) [fix][test] Fix UnfinishedStubbing issue in AuthZTests (#24098) [fix][ml] Skip deleting cursor if it was already deleted before calling unsubscribe (#24154) [fix][broker] Directly query single topic existence when the topic is partitioned (#24118) [fix][broker] Add topic consistency check (#24056) [fix][test] Update partitioned topic subscription assertions in IncrementPartitionsTest (#24033) [cleanup][misc] Add override annotation (#24180) [improve][build] Build apachepulsar/pulsar-io-kinesis-sink-kinesis_producer with Alpine 3.21

​
AoP

255d5d8 Add back qpid-test-utils package

​
MoP

(#1731) Fix user properties lost when enable authorization

​
KoP

Support handle DESCRIBE_LOG_DIRS request

​
StreamNative Pulsar Plugins

Fix the time ticker leak issue which caused high CPU usage [cluster-rollout] add orphan unload job cleanup logic Update Go SDK rbac & oidc dependencies Update x/net and go 1.24 Fix jlink command’s compress argument

​
pulsarctl

(#1790) Add release workflow (#1784) Update to Go 1.24 to avoid CVEs

​
Function Mesh Worker Service

exclude lz4-java for CVE reasons Unified resource scale for all Objects and make it configurable

​
StreamNative Unified RBAC

Support batch apply role bindings

​
StreamNative Ursa storage

Fix topic quarantine bug Implement new interface for Pulsar Add default timeout for all integration tests External table support wal compact Disable expire Iceberg snapshot by default Support fencing a managed ledger after closing a4a8e721 Fix pom Use nonRetriableQuaratine for task publish Improve the compaction worker handle stream task logic. Flaky test in SimpleStorageImplTest.java [improve] Use ReentrantReadWriteLock in EntryCache Move out the integration test containers to a new module Add metrics for the read cache size in bytes Fix the NPE when getting the non-exists blob Fix the aws config socket time not work issue. Add more netty config Reduce primitive schema retry times Format compaction service quarantine logic Support configure iceberg table properties with topic properties Throw exception when read empty entries in lakehouse worker. [fix] throw exception upon EntryCache apis calls after EntryCache is closed Move the persistStorageApi initialize in the common place Fix real offset incorrect Fix semaphore not release bug Fix read lock not release bug Fix build failure GCS supports delete with lifecycle Throw exceptions when handle the recursive schema throw exception when hitting non-binary index while processing RAW type Support azure to delete object using lifecycle rules Delete the compact task when compaction worker read compacted wal file. Quarantine topic when get topic failed or get topic metadata failed

​
Security Fixes

​
Apache Pulsar

(#24232) [fix][sec] Upgrade Jetty to 9.4.57.v20241219 to mitigate CVE-2024-6763