What are Connectors?

StreamNative connectors enable you to easily integrate with external systems, allowing you to move data into and out of your Pulsar clusters. Connectors are available in two main categories:
  • Source Connectors: Pull data from external systems into Pulsar topics
  • Sink Connectors: Push data from Pulsar topics to external systems

Getting Started

Kafka Connect

Available Connectors

Browse our comprehensive library of pre-built connectors for popular data sources and destinations.

Source Connectors

ConnectorTypeDescriptionDocumentation
ActiveMQMessage QueueIntegrate with Apache ActiveMQ message brokerπŸ“– Docs
AMQP 1.0Message QueueConnect to AMQP 1.0 compatible message brokersπŸ“– Docs
CanalDatabase CDCMySQL binlog change data capture using Alibaba CanalπŸ“– Docs
Debezium MongoDBDatabase CDCMongoDB change data capture using DebeziumπŸ“– Docs
Debezium SQL ServerDatabase CDCSQL Server change data capture using DebeziumπŸ“– Docs
Debezium MySQLDatabase CDCMySQL change data capture using DebeziumπŸ“– Docs
Debezium PostgreSQLDatabase CDCPostgreSQL change data capture using DebeziumπŸ“– Docs
DynamoDBDatabaseRead data from AWS DynamoDBπŸ“– Docs
FileFile SystemRead data from local or remote filesπŸ“– Docs
FlumeData CollectionIntegrate with Apache Flume data collection serviceπŸ“– Docs
Google BigQueryAnalyticsRead data from Google BigQuery tablesπŸ“– Docs
Google Pub/SubMessage QueueConsume messages from Google Cloud Pub/SubπŸ“– Docs
Kafka Connect Debezium MongoDBDatabase CDCDebezium MongoDB source connector via Kafka ConnectπŸ“– Docs
Kafka Connect JRTestingGenerate test data with JSON Schema RegistryπŸ“– Docs
Kafka Connect MongoDBDatabaseMongoDB source connector via Kafka ConnectπŸ“– Docs
YugabyteDB CDCDatabase CDCYugabyteDB change data captureπŸ“– Docs
KafkaMessage QueuePull data from Apache Kafka topicsπŸ“– Docs
KinesisStream ProcessingAmazon Kinesis data streams integrationπŸ“– Docs
LakehouseData LakeRead from lakehouse storage systemsπŸ“– Docs
NettyNetworkTCP/UDP network data ingestionπŸ“– Docs
RabbitMQMessage QueueConsume from RabbitMQ message brokerπŸ“– Docs
Amazon SQSMessage QueueAmazon Simple Queue Service integrationπŸ“– Docs
Twitter FirehoseSocial MediaReal-time Twitter data streamingπŸ“– Docs

Sink Connectors

ConnectorTypeDescriptionDocumentation
ActiveMQMessage QueueSend data to Apache ActiveMQ message brokerπŸ“– Docs
AerospikeDatabaseHigh-performance NoSQL database integrationπŸ“– Docs
AMQP 1.0Message QueueSend to AMQP 1.0 compatible message brokersπŸ“– Docs
AWS EventBridgeEvent ProcessingAmazon EventBridge event bus integrationπŸ“– Docs
AWS LambdaServerlessTrigger AWS Lambda functionsπŸ“– Docs
Amazon S3Object StorageStore data in Amazon S3 bucketsπŸ“– Docs
Azure Blob StorageObject StorageMicrosoft Azure blob storage integrationπŸ“– Docs
CassandraDatabaseApache Cassandra distributed databaseπŸ“– Docs
ElasticsearchSearch EngineElasticsearch full-text search and analyticsπŸ“– Docs
FlumeData CollectionSend data to Apache FlumeπŸ“– Docs
Google BigQueryAnalyticsLoad data into Google BigQueryπŸ“– Docs
Google Cloud StorageObject StorageStore files in Google Cloud StorageπŸ“– Docs
Google Pub/SubMessage QueuePublish to Google Cloud Pub/SubπŸ“– Docs
HBaseDatabaseApache HBase distributed databaseπŸ“– Docs
HDFS3File SystemHadoop Distributed File System v3πŸ“– Docs
InfluxDBTime SeriesTime series database for metrics and eventsπŸ“– Docs
JDBC ClickHouseAnalyticsClickHouse columnar database via JDBCπŸ“– Docs
JDBC MariaDBDatabaseMariaDB relational database via JDBCπŸ“– Docs
JDBC PostgreSQLDatabasePostgreSQL relational database via JDBCπŸ“– Docs
JDBC SQLiteDatabaseSQLite embedded database via JDBCπŸ“– Docs
Kafka Connect BigQueryAnalyticsBigQuery integration via Kafka ConnectπŸ“– Docs
Kafka Connect DataGenTestingGenerate test data for developmentπŸ“– Docs
Kafka Connect ElasticsearchSearch EngineElasticsearch via Kafka Connect frameworkπŸ“– Docs
Kafka Connect IcebergData LakeApache Iceberg table format integrationπŸ“– Docs
Kafka Connect MilvusVector DatabaseMilvus vector database for AI/ML workloadsπŸ“– Docs
Kafka Connect MongoDBDatabaseMongoDB via Kafka Connect frameworkπŸ“– Docs
Kafka Connect SnowflakeData WarehouseSnowflake cloud data warehouseπŸ“– Docs
KafkaMessage QueueSend data to Apache Kafka topicsπŸ“– Docs
KinesisStream ProcessingAmazon Kinesis data streamsπŸ“– Docs
LakehouseData LakeWrite to lakehouse storage systemsπŸ“– Docs
MongoDBDatabaseMongoDB document databaseπŸ“– Docs
PineconeVector DatabasePinecone vector database for ML applicationsπŸ“– Docs
RabbitMQMessage QueueSend to RabbitMQ message brokerπŸ“– Docs
RedisCacheRedis in-memory data structure storeπŸ“– Docs
SnowflakeData WarehouseSnowflake cloud data platformπŸ“– Docs
Snowflake StreamingData WarehouseSnowflake real-time data ingestionπŸ“– Docs
SolrSearch EngineApache Solr search platformπŸ“– Docs
Amazon SQSMessage QueueAmazon Simple Queue ServiceπŸ“– Docs

What’s Next?