produce
and consume
permissions to a namespace for the target topic.jq
CLI JSON processor, which provides a JSON-format output.9200
and 9300
.
_YOUR_HOME_DIRECTORY_/kafka_2.13-3.1.0
directory that you created earlier.
connectors
folder to store all Kafka connectors.
connectors
directory.
connect-sn-kop.properties
).
connect-sn-kop.properties
file.
oauth.credentials.url
: the path to your downloaded OAuth2 credential file.bootstrap.servers
: the Kafka service URL of your StreamNative cluster.oauth.audience
: the audience
parameter is a combination of the urn:sn:pulsar
, your organization name, and your Pulsar instance name.key.converter
and value.converter
: the converter that sends JSON-format messages to Kafka.plugin.path
: the full path of the connectors
folder that is created in the previous step.elasticsearch-sink-connector.properties
file.
test-elasticsearch-sink
topic. These messages will be forwarded to the local Elasticsearch server.
test-elasticsearch-sink
topic.
test-elasticsearch-sink
. The name of the index is the same as the name of the Kafka topic. By default, the Elasticsearch Sink connector creates the index with the same name.
For details about how to configure the Kafka configuration properties file, see get started with Kafka protocol.
test-elasticsearch-sink
index.
test-elasticsearch-sink
index.
This example shows how to search the keyword health
in the test-elasticsearch-sink
index.
health
listed in their content
field.