The HBase sink connector pulls the messages from Pulsar topics and persists the messages to HBase tables.
Configuration
The configuration of the HBase sink connector has the following properties.
Property
Name | Type | Default | Required | Description |
---|---|---|---|---|
hbaseConfigResources | String | None | false | HBase system configuration hbase-site.xml file. |
zookeeperQuorum | String | None | true | HBase system configuration about hbase.zookeeper.quorum value. |
zookeeperClientPort | String | 2181 | false | HBase system configuration about hbase.zookeeper.property.clientPort value. |
zookeeperZnodeParent | String | /hbase | false | HBase system configuration about zookeeper.znode.parent value. |
tableName | None | String | true | HBase table, the value is namespace:tableName . |
rowKeyName | String | None | true | HBase table rowkey name. |
familyName | String | None | true | HBase table column family name. |
qualifierNames | String | None | true | HBase table column qualifier names. |
batchTimeMs | Long | 1000l | false | HBase table operation timeout in milliseconds. |
batchSize | int | 200 | false | Batch size of updates made to the HBase table. |
Example
Before using the HBase sink connector, you need to create a configuration file through one of the following methods.
JSON
{ "hbaseConfigResources": "hbase-site.xml", "zookeeperQuorum": "localhost", "zookeeperClientPort": "2181", "zookeeperZnodeParent": "/hbase", "tableName": "pulsar_hbase", "rowKeyName": "rowKey", "familyName": "info", "qualifierNames": [ 'name', 'address', 'age'] }
YAML
configs: hbaseConfigResources: "hbase-site.xml" zookeeperQuorum: "localhost" zookeeperClientPort: "2181" zookeeperZnodeParent: "/hbase" tableName: "pulsar_hbase" rowKeyName: "rowKey" familyName: "info" qualifierNames: [ 'name', 'address', 'age']