StreamNative Weekly Release Notes v3.0.1.1

Download

Distributions

• https://github.com/streamnative/pulsar/releases/tag/v3.0.1.1

Packages

• Maven Central

Images

• sn-platform

General Changes

Apache Pulsar

[fix][broker] fix ModularLoadManagerImpl always delete active bundle-data. sec ver.

[fix][client] Fix RawReader hasMessageAvailable returns true when no messages

[fix][meta] Fix deadlock in AutoRecovery.

[fix][broker] Fix incorrect unack msk count when dup ack a message

[fix][broker] Fix compaction subscription delete by inactive subscription check.

[fix] [admin] Fix get topic stats fail if a subscription catch up concurrently

[fix][broker] Fix inconsensus namespace policies by getPoliciesIfCached

[improve][broker] Avoid print redirect exception log when get list from bundle

[fix][broker] Inconsistent behaviour for topic auto_creation

[improve] [ws] add cryptoKeyReaderFactoryClassName into the file websocket.conf

[improve][offload] Extend the offload policies to allow specifying more conf

[improve][client] Disable polling pattern topics when TopicListWatcher is enabled.

[fix][test] Close the resource after the test

[improve][offload] Create offload resources lazily

[fix] [broker] Can not receive any messages after switch to standby cluster

[fix][broker] Fix get topic policies as null during clean cache

[fix][broker] Avoid throwing RestException in BrokerService

[fix][client] Fix subscribing pattern topics through Proxy not working

[improve][offload] Support to configure more offload driver

[fix][schema] Only handle exception when there has

[fix] [client] Messages lost when consumer reconnect

[improve][admin] Remove duplicate topics name when deleteNamespace

[fix] [txn] fix consumer can receive aborted txn message when readType is replay

[fix] [io] elastic-search sink connector not support JSON.String schema.

[improve] [broker] Add consumer-id into the log when doing subscribe.

[fix][broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin

[fix][broker] Gracefully shutdown does not work with admin cli in standalone

[improve][sql] Fix the wrong format of the logs

[fix][client] Fix perf-producer get OOM with high publish latency

[fix][broker] fix MessageDeduplication throw NPE when enable broker dedup and set namespace disable deduplication.

[fix][io] Update test certs for Elasticsearch

[fix][broker] Fix message loss during topic compaction

(#20980))) Revert "[fix][broker] Fix message loss during topic compaction

[fix][broker] Fix message loss during topic compaction

[fix][broker] Fix incorrect number of read compacted entries

[fix] [ml] fix discontinuous ledger deletion

[fix][broker] In replication scenario, remote consumer could not be registered if there has no message was sent

[improve][broker] Add annotation for topic compaction strategy

[fix][broker] Avoid infinite bundle unloading

[improve][broker] Add broker filter sync method back to guarantee the API compatibility

[fix][build] Upgrade PyYaml version to 6.0.1

[fix] [cli] the variable producerName of BatchMsgContainer is null

[fix][broker] call ServerCnx#closeProducer from correct thread

[fix][io][branch-3.0] Not restart instance when kafka source poll exception.

[fix][test] Fix resource leak in PulsarTestContext

[fix][test] Fix flaky PersistentSubscriptionTest

[fix][sec] Upgrade snappy-java to address multiple CVEs

f3bb89d4a6 Revert Add listener interface for namespace service #20406

[fix] Ignore openIDTokenIssuerTrustCertsFilePath conf when blank

[fix][ws] Remove unnecessary ping/pong implementation

AoP

remove useless test code

MoP

Fix connection timeout ms

Fix dispatch docker build

Support fast build docker image

Support batch ack in broker

Upgrade pulsar verison to 3.0.0.4

(#1047))) Revert "Add ping request for adapter channel

Fix close reader NPE.

113a653 Improve test.

Add ping request for adapter channel

Fix mock object

Fix publish latency unit

Improve log to avoid too much error

Fix bundle is being unload IllegalState exception

Fix NPE cased by inflating message

Fix lookup issue for MQTT-5

Fix IllegalReferenceCountException exception to break the callback

Change log level to debug

Add Cache for event writer.

843fdf1 Fix connect timeout ms

StreamNative Pulsar Plugins

[rest] Fix bytebuf twice release

Specify antrun version to avoid api breaking

Supplemental testing for broker E2E compression

Support manualDecompression request flag

Support broker do compression.

Support publishing and consuming by rest

Support E2E compression - P2

Support E2E compression - P1

Cloud Pulsar Plugins

Fixed pulsar api key audience list issuer

Support audience list

Do not catch parseClaimsJwt method exception

[improve] Add cache for parse claims Jwt

Fix authenticate http request

[improve] Move authz parse jwt body logic to authenticaiton state init stage

Function Mesh Worker Service

Remove enableStateStore from CustomRuntimeOptions

allow by-pass the class loader from connector package

dependencies alignment

release function-mesh 0.15.0

Use state store to query/put state

Add missing config

Handle delete response when failed to delete k8s object

bd9f2b03 Use pulsarctl runner image

Add missed permissions checks

Append version to the description field of ConnectorDefinition

Respect --update-auth-data parameter

expose k8s 404 and other rest errors with correct error code

bump k8s to 1.23.17

remove java17 grammar for backward comp

Bump k8s to 18.0.0

add service account annotation if is created via sn cloud service account

Fix permission error in ci's Dockerfile

prevent cleanup fail the action

Aws EventBridge Connector

Refactor docs struct and content.

Improve config docs.

Improve prerequisites docs.