source
Twitter Source
The Twitter Firehose source connector receives tweets from Twitter Firehose and writes the tweets to Pulsar topics.
Authored by
ASF
Support type
StreamNative
License
Apache License 2.0

The Twitter Firehose source connector receives tweets from Twitter Firehose and writes the tweets to Pulsar topics.

Configuration

The configuration of the Twitter Firehose source connector has the following properties.

Property

NameTypeRequiredSensitiveDefaultDescription
consumerKeyStringtruetrue" " (empty string)The twitter OAuth consumer key.<br><br>For more information, see Access tokens.
consumerSecretStringtruetrue" " (empty string)The twitter OAuth consumer secret.
tokenStringtruetrue" " (empty string)The twitter OAuth token.
tokenSecretStringtruetrue" " (empty string)The twitter OAuth secret.
guestimateTweetTimeBooleanfalsefalsefalseMost firehose events have null createdAt time.<br><br>If guestimateTweetTime set to true, the connector estimates the createdTime of each firehose event to be current time.
clientNameStringfalsefalseopenconnector-twitter-sourceThe twitter firehose client name.
clientHostsStringfalsefalseConstants.STREAM_HOSTThe twitter firehose hosts to which client connects.
clientBufferSizeintfalsefalse50000The buffer size for buffering tweets fetched from twitter firehose.

For more information about OAuth credentials, see Twitter developers portal.