StreamNative Weekly Release Notes v4.0.0.10

Download

Distributions

https://github.com/streamnative/pulsar/releases/tag/v4.0.0.10

Packages

Maven Central

Images

General Changes

Apache Pulsar

[fix][broker] Avoid block markDeletePosition forward when skip lost entries

[improve] [test] Add more test for the case that client receives a SendError, which relates to the PR #23038

[fix][doc] Refine ClientBuilder#memoryLimit and ConsumerBuilder#autoScaledReceiverQueueSizeEnabled javadoc

[fix][client] Fix wrong start message id when it's a chunked message id

[fix] [broker] fix NPE when calculating a topic's backlogQuota

[improve][client] Print consumer stats log if prefetched messages are not zero

[fix][broker] Fix the retry mechanism in MetadataCache#readModifyUpdateOrCreate

[fix] [broker] Fix config replicationStartAt does not work when set it to earliest

[improve][admin] Opt-out of topic-existence check

[fix][admin] Listen partitioned topic creation event

[fix][broker] Catch exception for entry payload interceptor processor

KoP

Handle schema registry authorization compatibility issue

Cloud Storage Connector

Exist connector process when encounter exception

StreamNative Pulsar Plugins

Add pulsar-oxia-state-store jar package

Just add non fat jar to image

Use SN bom

Cloud Pulsar Plugins

Use SN bom

Function Mesh Worker Service

Add extraDependency field to FunctionMeshConnectorDefinition

Google BigQuery Sink Connector

Optimize getGoogleCredentials exception

Aws EventBridge Connector

Remove require annotation for assessKey and secretKey

StreamNative Unified RBAC

feat(sdk-go-cloud): upgrade sdk-go to 0.1.16

feat(sdk-go): schema cel support

disable permission check to get better compatibility

feat(sdk-java): upgrade version to 1.3.0

upgrade sdk to 0.1.15

feat: support schema permissions

Add schema permissions

feat(sdk-go-cloud): support role cache to avoid io call

feat(sdk-java-pulsar): support missing computing component permissions

feat(sdk-go-cloud): upgrade sdk-go to version 0.1.14

fix(sdk-go): avoid filter the permissions for application role

feat(cv): support binding with cel

build(deps): bump nanoid from 3.3.7 to 3.3.8 in /sdk/sdk-js

fix(cv): fix the private repo visibility

feat(cv): support integration test

feat(sdk-go-cloud): upgrade sdk-go to 0.1.12

ci: fix CI to make sure test passed

fix(sdk-go-x): filter pulsar service admin permission

feat(sdk-apiserver): support sdk-apiserver

feat(sdk-java-pulsar): Implement broker rbac filter

feat(sdk-go-cloud): upgrade sdk

StreamNative Ursa storage

Add core and lakehouse jars to image

Support unity catalog.

Add iceberg support

Remove jar with dependencies when release

Switch to sn-bom pom dependency

[cleanup] Remove the duplicated code

Separate the integration tests and ut in workflows

Enable all the primitive types tests

Limit the read request from compaction to the storage api

Get the compact task in the start offset order

Security Fixes

Apache Pulsar

[fix][sec] Upgrade async-http-client to 2.12.4 to address CVE-2024-53990

[fix][sec] Mitigate CVE-2024-53990 by disabling AsyncHttpClient CookieStore