StreamNative Weekly Release Notes v3.1.2.1

Download

Distributions

• https://github.com/streamnative/pulsar/releases/tag/v3.1.2.1

Packages

• Maven Central

Images

• sn-platform

General Changes

Apache Pulsar

[improve][broker] Improve NamespaceUnloadStrategy error message

[fix][txn] Fix getting last message ID when there are ongoing transactions

[improve][broker] Skip loading the NAR packages if not configured

[fix][sec] Exclude avro from hadoop-client

[improve] [client] Prevent reserve memory with a negative memory size to avoid send task stuck

[fix][client] Fix messages in the batch container timed out unexpectedly

[fix][broker] fix the wrong value of BrokerSrevice.maxUnackedMsgsPerDispatcher

[fix][broker]Fix NonPersistentDispatcherMultipleConsumers ArrayIndexOutOfBoundsException

[improve][build] Add a default username in the image

[fix] [broker] Fix break change: could not subscribe partitioned topic with a suffix-matched regexp due to a mistake of PIP-145

[fix] [client] Messages lost due to TopicListWatcher reconnect

[improve][broker] Don't rollover empty ledgers based on inactivity

[fix][broker] Fix compaction/replication data loss when expire messages

[fix] [ml] Fix retry mechanism of deleting ledgers to invalidate

[improve][broker] defer the ownership checks if the owner is inactive (ExtensibleLoadManager)

[fix] [broker] Update topic policies as much as possible when some ex was thrown

[improve][io] Make connectors load sensitive fields from secrets

[fix][broker] Delete compacted ledger when topic is deleted

[fix][broker] Avoid compaction task stuck when the last message to compact is a marker

[fix][fn] Fix Deadlock in Functions Worker LeaderService

[fix][test] Fix PerformanceProducer send count error

[improve][broker] cleanup the empty subscriptionAuthenticationMap in zk when revoke subscription permission

[fix][broker] Fix TableViewLoadDataStoreImpl NPE

[improve][proxy] Fix comment about enableProxyStatsEndpoints

b0e8b5abb5 Upgrade OWASP dependency check maven plugin version

KoP

Fix offset commit timeout error due to incorrect send timer implementation

9f421ac6 Set project version with 3.1.x

[schema-registry] Support TLS authentication

[schema-registry] Wait reader read latest data after writing

[schema-registry] Support list subjects for schema

[feature] Support TLS authentication

Only authentication SASL_PLAINTEXT OR SASL_SSL endpoint

Increase the default maxReadEntriesNum to 50

[schema-registry] Support https protocol and multi-listeners

Make loading offsets synchronous to avoid race condition

Cloud Storage Connector

[Doc] Add doc for includeTopicToMetadata configuration

Add default value for the partitionType to partition

[feat][proposal-2] Support including the topic name to the metadata(#836)

[Proposal-2] Support including the topic name to the metadata

Add AWS-S3-Sink doc for proposal-1

Add doc for new partitioner

[Proposal-1] Support Partitioner Refactoring

Proposal-1: Partitioner Refactoring

AMQP1_0 Connector

Fix incorrect docker images link.

pulsarctl

Update jose2go to fix GHSA-mhpq-9638-x6pw

StreamNative Pulsar Plugins

[fix][cve] Exclude logback from zookeeper

[fix][detector] Cleanup inactive broker's e2e detector

Include one older txn log file in the backup when needed

Update jose2go to 1.6.0 to address GHSA-mhpq-9638-x6pw

Upgrade pulsar to 3.1.1.2

Release SN-RBAC to branch-3.1

Cloud Pulsar Plugins

Fix build.sh

Release apikeys&oauth2 module first in build.sh

Fix test pom

Release SN-RBAC to branch-3.1

Function Mesh Worker Service

add transformFunctionEnabled and disabled by default