Skip to main content
Add a StreamNative Pulsar or Kafka cluster to a ready SQL Workspace. Each SQL Catalog appears as a database in the SQL Workspace engine.

Before you begin

You need:
  • A Ready SQL Workspace.
  • A Pulsar or Kafka cluster in the same organization.
  • A cloud role that permits SQL Catalog management.

Add a catalog

  1. In the Cloud Console, click SQL.
  2. Open the workspace selector and click Manage workspaces.
  3. Open the action menu for the target workspace and click Manage.
  4. In the Databases section, click Import clusters.
  5. Select an instance.
  6. Select one or more Pulsar or Kafka clusters.
  7. Confirm the database name for each selected cluster.
  8. Click Import.
  9. Wait until each imported database reports Ready.
SQL Workspaces page in the StreamNative Cloud Console

Open workspace management to view SQL Workspaces.

Manage action in the SQL Workspace menu

Open the action menu and manage the target SQL Workspace.

Import clusters action for a SQL Workspace

Import Pulsar or Kafka clusters as SQL Catalogs.

What happens next

StreamNative creates a database for each SQL Catalog, periodically discovers eligible topics, and creates missing source objects in that database. Refer to topic-derived schemas and sources with double-quoted identifiers. This Pulsar example uses the public/default namespace; Kafka sources use the public schema.
Create the tables or materialized views needed for subsequent transformations and continuous processing. For details, see SQL Catalog. Removing the SQL Catalog later stops topic discovery and stops its managed sources from consuming newly published records. Data already ingested or processed by the SQL Workspace engine is retained, and the source cluster and its topics are not deleted. See Data Retention. Next, query with SQL Studio or connect with a PostgreSQL client.