​
StreamNative Weekly Release Notes v4.0.1.4

​
Download

​
Distributions

​
Packages

​
Images

​
General Changes

​
Apache Pulsar

(#23331) [fix][broker] fix broker may lost rack information

(#23984) [fix][meta] Fix ephemeral Zookeeper put which creates a persistent znode

(#23796) [fix][broker] Fix incorrect blockedConsumerOnUnackedMsgs value when maxUnackedMessagesPerConsumer is 1

(#23981) [improve][proxy] Make keep-alive interval configurable in Pulsar Proxy

(#23979) [fix][io] Fix pulsar-io:pom not found

(#23969) [improve][client] Update TypedMessageBuilder deliverAfter and deliverAt api comment

(#23967) [fix][client] Fix memory leak when message size exceeds max message size and batching is enabled

(#23971) [fix][client] Fix memory leak in ClientCnx.newLookup when there’s TooManyRequestsException

(#23899) [fix] Bump org.apache.solr:solr-core from 8.11.3 to 9.8.0 in /pulsar-io/solr

(#23970) [improve][ci] Skip “OWASP dependency check” when data wasn’t found in cache

(#23966) [fix][build] Upgrade json-smart to 2.5.2

(#23957) [improve][broker] Avoid PersistentReplicator.expireMessages logic compute backlog twice

(#23960) [fix][ml] Fix memory leaks in ManagedCursorInfo and ManagedLedgerInfo decompression and compression

(#23964) [fix] Use Alpine 3.21 in base image

(#23958) [fix][ml] Fix deadlock in PendingReadsManager

(#23915) [improve][broker] Refactor a private method to eliminate an unnecessary parameter

(#23919) [fix][broker] Fix seeking by timestamp can be reset the cursor position to earliest

(#23951) [fix] [ml] incorrect non-durable cursor’s backlog due to concurrently trimming ledger and non-durable cursor creation

(#23615) [fix][broker] Skip to persist cursor info if it failed by cursor closed

(#23955) [fix][ml] Fix memory leak due to duplicated RangeCache value retain operations

(#23940) [improve][ml] Do not switch thread to execute asyncAddEntry’s core logic

(#23943) [fix] [client] call redeliver 1 msg but did 2 msgs

(#23930) [fix][broker] Fix rate limiter token bucket and clock consistency issues causing excessive throttling and connection timeouts

(#23947) [feat][client] Support forward proxy for the ZTS server in pulsar-client-auth-athenz

(#23932) [improve][io] Allow skipping connector deployment

(#23938) [improve][broker] Avoid printing log for IncompatibleSchemaException in ServerCnx

(#23939) [improve][broker] Avoid logging errors when there is a connection issue during subscription.

(#23928) [improve][broker] Do not print error logs for NotFound or Conflict errors when using the Admin API

(#23929) [improve][broker] Don’t print error logs for ProducerBusyException

(#23935) [improve][client] Avoid logging errors for retriable errors when creating producer

(#23884) [fix][broker] Closed topics won’t be removed from the cache

​
KoP

Support wildcard characters for kopAllowedNamespaces

​
StreamNative Pulsar Plugins

feat(detector): support pprof

fix: discard superuser flag to avoid deadlock

fix(detector): compatible with non-partitioned aliveness topic

Change error log to warn when topic closed

​
Function Mesh Worker Service

Fix update error for functions/sinks/sources with secrets injected

Support set log topic from configs for Sinks&Sources

Support set resources for kafka connect

​
StreamNative Ursa storage

Support nested protobuf schema for the compaction

Move the create table to the writer instead committer

Add test case to cover msg payload schema content

Remove copied class

Remove the ursa-lakehouse dependency from the ursa-ml

Add iceberg external table support

Support kafka protobuf schema for the compaction

Fix BrokerInterceptorTest.testAddBrokerEntryMetadataEntryRef flaky test.

Add test unit to cover get wrong streamId issue.

Fix CI

Fix the json schema convert issue.

Fix always use the wrong streamId when publish stream task.

Set partitionkey for the rangeScan in the persistStorageApi

Add the persistCache size into the meta

Improve PersistCache with a simpler and thread-safe implementation

Add EntryIndex protobuf

feat: move the info log to debug to prevent server keep logging

[cleanup] Remove unused api

Refactor compaction worker interface

Replace guava cache with caffeine cache

[cleanup] Move the read cache into a single class

Clean up the unused code of ursa-storage-core

Remove the unused code

Unity Catalog support clientId and clientSecret to authenticate.

Use ubuntu-latest to run ci

Fix Github Packages publish workflow

Remove nexus snapshot distribution

Use ____ to replace ’-’ for table name when create unity catalog table.

Support publishing to GitHub Packages

​
Security Fixes

​
Apache Pulsar

(#23965) [fix][sec] Upgrade to Netty 4.1.118