Skip to main content
SQL Workspaces provide a managed architecture for processing streams from StreamNative Pulsar and Kafka clusters with PostgreSQL-compatible SQL.
SQL Workspaces are available by invitation only. During Private Preview, manage SQL Workspace and SQL Catalog resources through the StreamNative Cloud Console. You can query a workspace through SQL Studio or its native PostgreSQL endpoint.

Get started

Create a workspace, add a catalog, and run a query.

Understand access control

Learn how cloud resource and SQL Workspace engine permissions work.

Understand SQL Workspace

Learn about the engine model, placement, lifecycle, and query endpoints.

Understand SQL Catalog

Learn how Pulsar and Kafka clusters map to databases and topic sources.

​
Architecture

​
Components

​
Setup flow

  1. A user creates a SQL Workspace in an eligible hosted location or ready BYOC Cloud Environment through the Cloud Console.
  2. StreamNative prepares the SQL Workspace in the selected placement. During Private Preview, SQL Workspaces are supported only on AWS.
  3. The user adds a Pulsar or Kafka cluster as a SQL Catalog.
  4. The SQL Catalog represents the cluster as a database in the SQL Workspace.
  5. The user creates tables or materialized views based on the managed topic sources for subsequent processing.

​
Query flow

  1. Pulsar or Kafka delivers new events to the connected topics.
  2. The SQL Catalog makes eligible topics from its connected cluster available to the SQL Workspace.
  3. The SQL Workspace evaluates ad hoc queries or continuously maintains materialized views.
  4. Users submit SQL and retrieve results through SQL Studio or a PostgreSQL-compatible client.