What are Connectors?

StreamNative connectors enable you to easily integrate with external systems, allowing you to move data into and out of your Pulsar clusters. Connectors are available in two main categories:

  • Source Connectors: Pull data from external systems into Pulsar topics
  • Sink Connectors: Push data from Pulsar topics to external systems

Getting Started

Kafka Connect

Available Connectors

Browse our comprehensive library of pre-built connectors for popular data sources and destinations.

Source Connectors

ConnectorTypeDescriptionDocumentation
ActiveMQMessage QueueIntegrate with Apache ActiveMQ message broker📖 Docs
AMQP 1.0Message QueueConnect to AMQP 1.0 compatible message brokers📖 Docs
CanalDatabase CDCMySQL binlog change data capture using Alibaba Canal📖 Docs
Debezium MongoDBDatabase CDCMongoDB change data capture using Debezium📖 Docs
Debezium SQL ServerDatabase CDCSQL Server change data capture using Debezium📖 Docs
Debezium MySQLDatabase CDCMySQL change data capture using Debezium📖 Docs
Debezium PostgreSQLDatabase CDCPostgreSQL change data capture using Debezium📖 Docs
FileFile SystemRead data from local or remote files📖 Docs
FlumeData CollectionIntegrate with Apache Flume data collection service📖 Docs
Google BigQueryAnalyticsRead data from Google BigQuery tables📖 Docs
Google Pub/SubMessage QueueConsume messages from Google Cloud Pub/Sub📖 Docs
Kafka Connect JRTestingGenerate test data with JSON Schema Registry📖 Docs
Kafka Connect MongoDBDatabaseMongoDB source connector via Kafka Connect📖 Docs
YugabyteDB CDCDatabase CDCYugabyteDB change data capture📖 Docs
KafkaMessage QueuePull data from Apache Kafka topics📖 Docs
KinesisStream ProcessingAmazon Kinesis data streams integration📖 Docs
LakehouseData LakeRead from lakehouse storage systems📖 Docs
NettyNetworkTCP/UDP network data ingestion📖 Docs
RabbitMQMessage QueueConsume from RabbitMQ message broker📖 Docs
Amazon SQSMessage QueueAmazon Simple Queue Service integration📖 Docs
Twitter FirehoseSocial MediaReal-time Twitter data streaming📖 Docs

Sink Connectors

ConnectorTypeDescriptionDocumentation
ActiveMQMessage QueueSend data to Apache ActiveMQ message broker📖 Docs
AerospikeDatabaseHigh-performance NoSQL database integration📖 Docs
AMQP 1.0Message QueueSend to AMQP 1.0 compatible message brokers📖 Docs
AWS EventBridgeEvent ProcessingAmazon EventBridge event bus integration📖 Docs
AWS LambdaServerlessTrigger AWS Lambda functions📖 Docs
Amazon S3Object StorageStore data in Amazon S3 buckets📖 Docs
Azure Blob StorageObject StorageMicrosoft Azure blob storage integration📖 Docs
CassandraDatabaseApache Cassandra distributed database📖 Docs
ElasticsearchSearch EngineElasticsearch full-text search and analytics📖 Docs
FlumeData CollectionSend data to Apache Flume📖 Docs
Google BigQueryAnalyticsLoad data into Google BigQuery📖 Docs
Google Cloud StorageObject StorageStore files in Google Cloud Storage📖 Docs
Google Pub/SubMessage QueuePublish to Google Cloud Pub/Sub📖 Docs
HBaseDatabaseApache HBase distributed database📖 Docs
HDFS3File SystemHadoop Distributed File System v3📖 Docs
InfluxDBTime SeriesTime series database for metrics and events📖 Docs
JDBC ClickHouseAnalyticsClickHouse columnar database via JDBC📖 Docs
JDBC MariaDBDatabaseMariaDB relational database via JDBC📖 Docs
JDBC PostgreSQLDatabasePostgreSQL relational database via JDBC📖 Docs
JDBC SQLiteDatabaseSQLite embedded database via JDBC📖 Docs
Kafka Connect BigQueryAnalyticsBigQuery integration via Kafka Connect📖 Docs
Kafka Connect DataGenTestingGenerate test data for development📖 Docs
Kafka Connect ElasticsearchSearch EngineElasticsearch via Kafka Connect framework📖 Docs
Kafka Connect IcebergData LakeApache Iceberg table format integration📖 Docs
Kafka Connect MilvusVector DatabaseMilvus vector database for AI/ML workloads📖 Docs
Kafka Connect MongoDBDatabaseMongoDB via Kafka Connect framework📖 Docs
Kafka Connect SnowflakeData WarehouseSnowflake cloud data warehouse📖 Docs
KafkaMessage QueueSend data to Apache Kafka topics📖 Docs
KinesisStream ProcessingAmazon Kinesis data streams📖 Docs
LakehouseData LakeWrite to lakehouse storage systems📖 Docs
MongoDBDatabaseMongoDB document database📖 Docs
PineconeVector DatabasePinecone vector database for ML applications📖 Docs
RabbitMQMessage QueueSend to RabbitMQ message broker📖 Docs
RedisCacheRedis in-memory data structure store📖 Docs
SnowflakeData WarehouseSnowflake cloud data platform📖 Docs
Snowflake StreamingData WarehouseSnowflake real-time data ingestion📖 Docs
SolrSearch EngineApache Solr search platform📖 Docs
Amazon SQSMessage QueueAmazon Simple Queue Service📖 Docs

What’s Next?