StreamNative Weekly Release Notes v3.1.2.3

General Changes

Apache Pulsar

[improve][broker] Consistently add fine-grain authorization to REST API

[fix][broker][branch-3.1] Fix broker not starting when both transactions and the Extensible Load Manager are enabled

7e28e8404f Fix presto-distribution/LICENSE

[improve][fn] Add configuration for connector & functions package url sources

[fix][offload] Fix Offload readHandle cannot close multi times.

[fix] [broker] print non log when delete partitioned topic failed

[fix][txn]Fix TopicTransactionBuffer potential thread safety issue

[fix][sec] Upgrade Jetty to 9.4.54.v20240208 to address CVE-2024-22201

[fix][test] Fix test testAsyncFunctionMaxPending

[fix] [client] Do no retrying for error subscription not found when disabled allowAutoSubscriptionCreation

[fix][broker]Support setting autoSkipNonRecoverableData dynamically in expiryMon…

[fix][fn] Use unified PackageManagement service to download packages

[fix] [broker] Expire messages according to ledger close time to avoid client clock skew

[fix][build][branch-3.1] Fix compile issue in test

(#22101))) Revert "[improve][admin] Expose the offload threshold in seconds to the amdin

[improve][broker] Add fine-grain authorization to retention admin API

[fix][broker][branch-3.0] Return getOwnerAsync without waiting on source broker upon Assigning and Releasing and handle role change during role init

[fix][broker][branch-3.0] Set ServiceUnitStateChannel topic compaction threshold explicitly, improve getOwnerAsync, and fix other bugs

[improve][broker] Add an error log to troubleshoot the failure of starting broker registry.

[fix][ml] Make mlOwnershipChecker asynchronous so that it doesn't block/deadlock threads

[improve] [broker] Do not try to open ML when the topic meta does not exist and do not expect to create a new one. #21995

[fix][sec] Add a check for the input time value

[fix] [txn] Get previous position by managed ledger.

[improve][broker] Do not close the socket if lookup failed due to LockBusyException

[improve] [broker] Not close the socket if lookup failed caused by bundle unloading or metadata ex

[fix] [broker] Fix can not subscribe partitioned topic with a suffix-matched regexp

[fix] [broker] Subscription stuck due to called Admin API analyzeSubscriptionBacklog

[improve] [broker] Do not print an Error log when responding to HTTP-404 when calling Admin API and the topic does not exist.

[improve][broker] Do not retain the data in the system topic

[fix][test] fix test testSyncNormalPositionWhenTBRecover

[fix][broker] Fix hash collision when using a consumer name that ends with a number

[fix] [client] fix huge permits if acked a half batched message

[fix] [broker] Enabling batch causes negative unackedMessages due to ack and delivery concurrency

[improve][admin] Expose the offload threshold in seconds to the amdin

[improve][broker] Cache the internal writer when sent to system topic.

4da9a2070c Bump version to 3.1.3-SNAPSHOT

[fix][test] Fix test testTransactionBufferMetrics

[improve][ci] Exclude jose4j to avoid CVE-2023-31582

[fix] Bump org.apache.solr:solr-core from 8.11.1 to 8.11.3 in /pulsar-io/solr

[fix] [bk] Fix the BookKeeper license

a13326b23a Fix byte-buddy version in presto LICENSE

[improve][fn] Optimize Function Worker startup by lazy loading and direct zip/bytecode access

[fix][sec] Upgrade commons-compress to 1.26.0

[fix][broker] Support running docker container with gid != 0

[fix][broker][branch-3.1] Avoid PublishRateLimiter use an already closed RateLimiter

[fix][broker] Sanitize values before logging in apply-config-from-env.py script

[improve][ml] Filter out deleted entries before read entries from ledger.

AoP

[fix][test] Improve the declare exchange test

KoP

Update LICENSE

Cloud Storage Connector

[fix] Fix small batches flushed into S3 together with normal large batches

AWS Lambda Connector

Enable unit tests for weekly release

pulsarctl

201be18 Disable bk unit test and fix it later ---

StreamNative Pulsar Plugins

Use an old version of the sn/charts

Update pulsar-placement-policy module README

Add pulsar placement policy model to release channel

Add Pulsar placement policy module

736ad09e [fix][sec] Upgrade commons-compress to 1.26.0

Function Mesh Worker Service

a52f4467 Fix ci

d399115d Deprecate classloader