StreamNative Weekly Release Notes v3.0.1.1

Download

Distributions

Packages

Images

General Changes

Apache Pulsar

[fix][broker] fix ModularLoadManagerImpl always delete active bundle-data. sec ver. [fix][client] Fix RawReader hasMessageAvailable returns true when no messages [fix][meta] Fix deadlock in AutoRecovery. [fix][broker] Fix incorrect unack msk count when dup ack a message [fix][broker] Fix compaction subscription delete by inactive subscription check. [fix] [admin] Fix get topic stats fail if a subscription catch up concurrently [fix][broker] Fix inconsensus namespace policies by getPoliciesIfCached [improve][broker] Avoid print redirect exception log when get list from bundle [fix][broker] Inconsistent behaviour for topic auto_creation [improve] [ws] add cryptoKeyReaderFactoryClassName into the file websocket.conf [improve][offload] Extend the offload policies to allow specifying more conf [improve][client] Disable polling pattern topics when TopicListWatcher is enabled. [fix][test] Close the resource after the test [improve][offload] Create offload resources lazily [fix] [broker] Can not receive any messages after switch to standby cluster [fix][broker] Fix get topic policies as null during clean cache [fix][broker] Avoid throwing RestException in BrokerService [fix][client] Fix subscribing pattern topics through Proxy not working [improve][offload] Support to configure more offload driver [fix][schema] Only handle exception when there has [fix] [client] Messages lost when consumer reconnect [improve][admin] Remove duplicate topics name when deleteNamespace [fix] [txn] fix consumer can receive aborted txn message when readType is replay [fix] [io] elastic-search sink connector not support JSON.String schema. [improve] [broker] Add consumer-id into the log when doing subscribe. [fix][broker]Check that the super user role is in the MultiRolesTokenAuthorizationProvider plugin [fix][broker] Gracefully shutdown does not work with admin cli in standalone [improve][sql] Fix the wrong format of the logs [fix][client] Fix perf-producer get OOM with high publish latency [fix][broker] fix MessageDeduplication throw NPE when enable broker dedup and set namespace disable deduplication. [fix][io] Update test certs for Elasticsearch [fix][broker] Fix message loss during topic compaction (#20980))) Revert “[fix][broker] Fix message loss during topic compaction [fix][broker] Fix message loss during topic compaction [fix][broker] Fix incorrect number of read compacted entries [fix] [ml] fix discontinuous ledger deletion [fix][broker] In replication scenario, remote consumer could not be registered if there has no message was sent [improve][broker] Add annotation for topic compaction strategy [fix][broker] Avoid infinite bundle unloading [improve][broker] Add broker filter sync method back to guarantee the API compatibility [fix][build] Upgrade PyYaml version to 6.0.1 [fix] [cli] the variable producerName of BatchMsgContainer is null [fix][broker] call ServerCnx#closeProducer from correct thread [fix][io][branch-3.0] Not restart instance when kafka source poll exception. [fix][test] Fix resource leak in PulsarTestContext [fix][test] Fix flaky PersistentSubscriptionTest [fix][sec] Upgrade snappy-java to address multiple CVEs f3bb89d4a6 Revert Add listener interface for namespace service #20406 [fix] Ignore openIDTokenIssuerTrustCertsFilePath conf when blank [fix][ws] Remove unnecessary ping/pong implementation

AoP

remove useless test code

MoP

Fix connection timeout ms Fix dispatch docker build Support fast build docker image Support batch ack in broker Upgrade pulsar verison to 3.0.0.4 (#1047))) Revert “Add ping request for adapter channel Fix close reader NPE. 113a653 Improve test. Add ping request for adapter channel Fix mock object Fix publish latency unit Improve log to avoid too much error Fix bundle is being unload IllegalState exception Fix NPE cased by inflating message Fix lookup issue for MQTT-5 Fix IllegalReferenceCountException exception to break the callback Change log level to debug Add Cache for event writer. 843fdf1 Fix connect timeout ms

StreamNative Pulsar Plugins

[rest] Fix bytebuf twice release Specify antrun version to avoid api breaking Supplemental testing for broker E2E compression Support manualDecompression request flag Support broker do compression. Support publishing and consuming by rest Support E2E compression - P2 Support E2E compression - P1

Cloud Pulsar Plugins

Fixed pulsar api key audience list issuer Support audience list Do not catch parseClaimsJwt method exception [improve] Add cache for parse claims Jwt Fix authenticate http request [improve] Move authz parse jwt body logic to authenticaiton state init stage

Function Mesh Worker Service

Remove enableStateStore from CustomRuntimeOptions allow by-pass the class loader from connector package dependencies alignment release function-mesh 0.15.0 Use state store to query/put state Add missing config Handle delete response when failed to delete k8s object bd9f2b03 Use pulsarctl runner image Add missed permissions checks Append version to the description field of ConnectorDefinition Respect —update-auth-data parameter expose k8s 404 and other rest errors with correct error code bump k8s to 1.23.17 remove java17 grammar for backward comp Bump k8s to 18.0.0 add service account annotation if is created via sn cloud service account Fix permission error in ci’s Dockerfile prevent cleanup fail the action

Aws EventBridge Connector

Refactor docs struct and content. Improve config docs. Improve prerequisites docs.