Skip to main content

StreamNative Weekly Release Notes v4.1.0.1

Download

Distributions

Packages

Images

General Changes

Apache Pulsar

(#24719) [fix][broker] Fix memory leak when metrics are updated in a thread other than FastThreadLocalThread (#24712) [improve][io] Upgrade to Debezium 3.2.2 (#24682) [improve][broker] Reduce unnecessary MessageMetadata parsing by caching the parsed instance in the broker cache (#24594) [improve][build] Disable javadoc build failure (#24706) [fix][broker] Fix NPE and annotate nullable return values for ManagedCursorContainer (#23942) [improve][client] PIP-407 Add newMessage with schema and transactions (#24699) [improve][ml] Improve cache insert performance by removing exists check since it’s already covered by putIfAbsent (#24689) [feat][misc] upgrade oxia version to 0.6.2 (#24691) [fix][client] Fix potential NPE in TypedMessageBuilderImpl (#24488) [improve][client] PIP-420: Supports users implement external schemas (#24684) [improve][doc] Cleanup some legacy PIP documents and improve PIP listing (#23351) [improve] [pip] PIP-382: Add a label named reason for topic_load_failed_total (#24648) [fix][broker]User topic failed to delete after removed cluster because of failed delete data from transaction buffer topic (#23222) [improve] [pip] PIP-375 Expose the Admin client configs: readTimeout, requestTimeout, and connectionTimeout (#23336) [fix][client] Fix ArrayIndexOutOfBoundsException when using SameAuthParamsLookupAutoClusterFailover (#24681) [improve][test]Add new test PartitionCreationTest.testGetPoliciesIfPartitionsNotCreated (#24678) [improve][doc] Update PIP links in PIP documents converted from the wiki and remove trailing whitespace (#24679) [fix][broker]Fix flaky test PartitionCreationTest.testCreateMissedPartitions (#24623) [improve][broker] Implement PIP-430 Pulsar Broker cache improvements (#24622) [improve][broker]Find the target position at most once, during expiring messages for a topic, even though there are many subscriptions (#24651) [fix][broker]Failed to create partitions after the partitions were deleted because topic GC (#24665) [fix][meta] Use getChildrenFromStore to read children data to avoid lost data (#23977) [fix][broker] Invalid regex in PulsarLedgerManager causes zk data notification to be ignored (#24663) [fix][client] Skip schema validation when sending messages to DLQ to avoid infinite loop when schema validation fails on an incoming message (#24669) [improve][io] Support specifying Kinesis KPL native binary path with 1.0 version specific path (#24668) [improve][build] Use org.apache.nifi:nifi-nar-maven-plugin:2.1.0 with skipDocGeneration=true (#24666) [improve][build] Increase maven resolver’s sync context timeout (#24427) [fix][broker] PIP-428: Fix corrupted topic policies issues with sequential topic policy updates (#24661) [improve][io] Upgrade AWS SDK v1 & v2, Kinesis KPL and KPC versions (#24662) [fix][client] fix ArrayIndexOutOfBoundsException in SameAuthParamsLookupAutoClusterFailover (#24655) [improve][ml] Optimize ledger opening by skipping fully acknowledged ledgers (#24660) [improve][doc] Add all legacy PIPs from Pulsar wiki and GitHub issues as files to pip directory (#24659) [fix][misc] Upgrade fastutil to 8.5.16

AoP

fix managed cursor container constructor in test

KoP

Support broker side schema validation Ursa: fix incorrect warn log when appending new messages Correct token extraction for Kafka internal client Remove useless authorization warning log [flaky-test] Fix ListConsumerGroupTest Fix build issue caused by upstream interface changes Remove dependencies with Confluent Community License Ignore the read_committed field in Ursa Resolve RBAC compatibility issue Fix topic read authorization not applied for OffsetDelete requests Add module name

StreamNative Pulsar Plugins

Adapt to the latest topic policies interface from PIP-428 Add audit logging support for non-partitioned topic creation

pulsarctl

Update stable version

StreamNative Ursa storage

Fix the external table commit state failed to check issue Fix build failure on the latest snapshot upgrade oxia version to 0.6.2 feat: upgrade oxia version to 0.6.1 IcebergTable support schema evolution Add test for #1253. Use number to convert the digital type at AvroToGenericRowConvert

Security Fixes

Apache Pulsar

(#24717) [fix][sec] Upgrade Netty to 4.1.127.Final to address CVEs