StreamNative Weekly Release Notes v3.1.0.2

Download

Distributions

https://github.com/streamnative/pulsar/releases/tag/v3.1.0.2

Packages

Maven Central

Images

General Changes

Apache Pulsar

(#21067) [fix][broker] Make sure all inflight writes have finished before completion of compaction

(#20988) [fix][broker] Fix can't stop phase-two of compaction even though messageId read reaches lastReadId

(#21061) [fix][broker] Use MessageDigest.isEqual when comparing digests

(#21031) [improve][proxy] Support disabling metrics endpoint

(#20620) [fix][broker] fix ModularLoadManagerImpl always delete active bundle-data. sec ver.

(#21032) [fix][client] Fix RawReader hasMessageAvailable returns true when no messages

(#21010) [fix][meta] Fix deadlock in AutoRecovery.

(#20990) [fix][broker] Fix incorrect unack msk count when dup ack a message

(#20983) [fix][broker] Fix compaction subscription delete by inactive subscription check.

(#20971) [fix] [admin] Fix get topic stats fail if a subscription catch up concurrently

SN KoP

[proxy] Support authentication and authorization

[proxy] Support TLS encryption between client and proxy

[improve] Use CompactedTopicUtils.asyncReadCompactedEntries instead of readCompactedEntries

[fix][compaction] Fix can't fetch compacted topic offset by timestamp if ledger is trimmed

ea09d8b2 Bump Pulsar to 3.1.0.1

[fix] Memory leak of the map in ThreadLocalAccessor

[improve] Fix the GC issue by removing unused delayed produce

[proxy] Do not share the same connection among different clients

[proxy] Support receiving messages from a single broker

[fix][admin] Describe topic cleanup policy config should return correct config

Try fixing flaky testListOffsetForEmptyRolloverLedger and add more logs

[build] Remove the build process for the binary tarball

[transaction] Check producer epoch before publish message

[proxy] Fix message disordering when sending messages

[build] Fix oauth client release

[fix][transaction] Use pulsar format when write marker to __consumer_offsets topic

Fix topic lookup failed exceptionally with ServiceUnitNotReady

[fix][transaction] Contains UUID when auto topic creation

[fix][transaction] Handle some failures in transaction

Update Kafka wire protocol to 3.4.0 and implement KIP-699 and KIP-709

Add Time based metric exipration.

pulsarctl

(#1170) Migrate pulsar-admin-go to apache pulsar client go

StreamNative Pulsar Plugins

Create pool netty buffer instead of nio buffer in rebatch kafka format

Improve KafkaCompactionParser according RecordBatch javadoc

Cloud Pulsar Plugins

Fixed pulsar api key audience list issuer

Function Mesh Worker Service

Bump fm to 0.16.0

Fix error that --retain-[key-]ordering not working

Revert "Remove enableStateStore from CustomRuntimeOptions

Fix producerConfig cannot be updated error

Expose some internal errors to users

Fix typos and broken links

Fix error that --batch-builder doesn't work for functions

Add FM Worker service content

Aws EventBridge Connector

(#98) Fix docs format for Note.

(#96) Fix wrong words in docs