StreamNative Private Cloud supports the Kafka protocol via the Ursa engine, a Kafka-compatible data streaming engine that has been refined through our extensive experience developing Pulsar, KoP (Kafka-on-Pulsar), and managing both Pulsar and Kafka at scale. Designed for today’s cost-conscious economy, Ursa offers a genuinely cloud-native experience and enterprise-grade features that boost developer productivity and operational efficiency.
To use the Kafka Protocol on StreamNative Private Cloud, you need to make sure using the image streamnative/private-cloud:3.1.0.4
or later.
To enable the Kafka Protocol on StreamNative Private Cloud, you need to configure the PulsarBroker
CR as follows:
spec.config.protocolHandlers.kop.enabled
: Required. A boolean to control whether the Kafka Protocol is enabled or disabled in a StreamNative cluster.spec.config.transactionEnabled
: Required. A boolean to control whether the Kafka Transaction is enabled or disabled in a StreamNative cluster.StreamNative supports a proxy extension which allows Kafka clients to connect and route Kafka traffic to a StreamNative cluster.
To use the Kafka Proxy on StreamNative Private Cloud, ensure that you are using image streamnative/private-cloud:3.1.0.4
or later, and that the Kafka Protocol has already been enabled in the cluster.
To use Kafka Proxy on StreamNative Private Cloud, you need to configure on the PulsarProxy
CR as follows:
spec.config.kopProxy.enabled
: Required. A boolean to control whether the Kafka Proxy is enabled or disabled in the StreamNative cluster.spec.config.kopProxy.kafkaAdvertisedListener
: Required. Specifies the listeners for Kafka clients. In Kubernetes environments, you should configure the external Proxy LoadBalancer
type service address or NodePort
type service address for this field.For example, on AWS EKS, you should config the following annotations to expose an external LoadBalancer
type service, then use the LoadBalancer
hostname as the kafkaAdvertisedListener
:
After enabling the Kafka Protocol on PulsarBroker
and Kafka Proxy on PulsarProxy
, we can follow below steps to have a quick tutorial:
Download the Kafka release
Click Produce messages through the Kafka Proxy
Consume messages through the Kafka Proxy
StreamNative Private Cloud supports the Kafka protocol via the Ursa engine, a Kafka-compatible data streaming engine that has been refined through our extensive experience developing Pulsar, KoP (Kafka-on-Pulsar), and managing both Pulsar and Kafka at scale. Designed for today’s cost-conscious economy, Ursa offers a genuinely cloud-native experience and enterprise-grade features that boost developer productivity and operational efficiency.
To use the Kafka Protocol on StreamNative Private Cloud, you need to make sure using the image streamnative/private-cloud:3.1.0.4
or later.
To enable the Kafka Protocol on StreamNative Private Cloud, you need to configure the PulsarBroker
CR as follows:
spec.config.protocolHandlers.kop.enabled
: Required. A boolean to control whether the Kafka Protocol is enabled or disabled in a StreamNative cluster.spec.config.transactionEnabled
: Required. A boolean to control whether the Kafka Transaction is enabled or disabled in a StreamNative cluster.StreamNative supports a proxy extension which allows Kafka clients to connect and route Kafka traffic to a StreamNative cluster.
To use the Kafka Proxy on StreamNative Private Cloud, ensure that you are using image streamnative/private-cloud:3.1.0.4
or later, and that the Kafka Protocol has already been enabled in the cluster.
To use Kafka Proxy on StreamNative Private Cloud, you need to configure on the PulsarProxy
CR as follows:
spec.config.kopProxy.enabled
: Required. A boolean to control whether the Kafka Proxy is enabled or disabled in the StreamNative cluster.spec.config.kopProxy.kafkaAdvertisedListener
: Required. Specifies the listeners for Kafka clients. In Kubernetes environments, you should configure the external Proxy LoadBalancer
type service address or NodePort
type service address for this field.For example, on AWS EKS, you should config the following annotations to expose an external LoadBalancer
type service, then use the LoadBalancer
hostname as the kafkaAdvertisedListener
:
After enabling the Kafka Protocol on PulsarBroker
and Kafka Proxy on PulsarProxy
, we can follow below steps to have a quick tutorial:
Download the Kafka release
Click Produce messages through the Kafka Proxy
Consume messages through the Kafka Proxy