Kafka Compatibility
Kafka client compatibility
Kafka on StreamNative (KSN) is compatible with Apache Kafka version from 0.9 to 3.4. Modern clients will automatically negotiate protocol versions or utilize an earlier protocol version that KSN brokers accept.
Note
We recommend always using the latest supported Kafka client version.
Language | Client | StreamNative Tested |
Java | Apache Kafka Java Client | 0.9.0.0, 0.10.2.2, 1.1.1, 2.4.1, 2.5.1, 2.6.3, 2.7.2, 2.8.2, 3.0.2, 3.1.2, 3.2.3, 3.3.2, 3.4.0 |
C/C++ | librdkafka | 1.9.2, 2.0.2, 2.1.1 |
Go | confluent-kafka-go | N/A |
Python | confluent-kafka-python | 1.9.2, 2.0.2, 2.1.1 |
Node.js | KafkaJS | N/A |
Note that the Kafka clients versions that have not been validated by StreamNative migh also compatible with KSN still compatible, particularly those based on librdkafka.
Unsupported Kafka features
KSN does not currently support the following Apache Kafka features:
Managing SASL users with Kafka Admin APIs: Use Pulsar Admin instead.
Limited support for Topic Configuration: Since the KSN is based on Pulsar, the storage layer differs from Kafka, so the topic config only supports cleanup.policy to set the compact or delete retention policy.
Limited support for Kafka Admin APIs:
Admin API KSN KoP abortTransaction(AbortTransactionSpec spec) - - alterClientQuotas - - alterConfigs - - alterConsumerGroupOffsets - - alterPartitionReassignments - - alterReplicaLogDirs - - alterUserScramCredentials - - createAcls - - createDelegationToken - - createPartitions YES YES createTopics YES YES deleteAcls - - deleteConsumerGroupOffsets YES - deleteConsumerGroups YES YES deleteRecords YES YES deleteTopics YES YES describeAcls - - describeClientQuotas - - describeCluster YES YES describeConfigs - - describeConsumerGroups YES YES describeDelegationToken - - describeFeatures - - describeLogDirs - - describeMetadataQuorum - - describeProducers - - describeReplicaLogDirs - - describeTopics YES YES describeTransactions - - describeUserScramCredentials - - electLeaders - - expireDelegationToken - - fenceProducers - - incrementalAlterConfigs - - listConsumerGroupOffsets YES YES listConsumerGroups YES YES listOffsets YES YES listPartitionReassignments - - listTopics YES YES listTransactions - - metrics YES YES removeMembersFromConsumerGroup - - renewDelegationToken - - unregisterBroker - - updateFeatures - -