Skip to main content
During Private Preview, SQLCatalog source discovery supports only Avro topics for both Pulsar and Kafka.
This compatibility matrix describes which topics are eligible for automatic source discovery. Query behavior for a discovered source is determined by the SQLWorkspace engine.
Kafka Schema Registry does not define separate primitive schema types. A primitive value encoded with Avro is classified as Avro; a raw or schema-less Kafka value is not supported. For schema definitions, see Kafka Schema Registry and the Apache Pulsar SchemaType reference.

​
Source requirements

  • A Pulsar topic must be persistent and use an Avro schema.
  • A Kafka topic must have an Avro value schema in Schema Registry.
  • Topics with an unsupported schema or no schema are skipped during discovery.
For how supported topics become managed sources, see Source Discovery.

​
Schema changes

Source discovery does not automatically rebuild an existing managed source after its upstream schema changes. Review and manage the existing engine object separately when a schema changes.