Skip to main content
This guide describes how to prepare a Databricks Unity Catalog for use with StreamNative Ursa as a Delta Lake catalog on Microsoft Azure.

​
Prerequisites

  • An Azure subscription with permissions to create storage accounts and Access Connectors
  • A Databricks workspace on Azure

​
1. Create an Access Connector for Azure Databricks

In the Azure Marketplace, search for Access Connector for Azure Databricks and click Create. Choose the resource group, provide a connector name (for example, unity-catalog-access-connector), and click Next. In the Managed Identity panel, enable System assigned identity, then click Next -> Create. Record the connector Resource ID:

​
2. Grant Storage Blob Data Contributor to the Connector

Open the storage account that will hold the Delta tables, navigate to Access Control (IAM) -> Add -> Add role assignment. Search for and select Storage Blob Data Contributor, then click Next. Choose Managed identity and select the Access Connector created in step 1. Click Next -> Review + assign.

​
3. Grant Storage Queue Data Contributor to the Connector

Repeat the process from step 2 with the Storage Queue Data Contributor role. Both roles are now assigned to the Access Connector.

​
4. Create a Storage Credential in Unity Catalog

In the Databricks Catalog console, navigate to Catalog -> Settings -> Credentials. Click Create Credential, provide a name, and paste the Access Connector Resource ID from step 1.

​
5. Create an External Location

In the Databricks Catalog console, create a new external location. Configure with:
  • Storage type: Azure Data Lake Storage
  • URL: abfss://<container>@<storage-account>.dfs.core.windows.net
  • Storage credential: the credential created in step 4
Click Test Connection to verify the credential.
Troubleshooting: If the test fails with a Hierarchical Namespace Enabled error, ensure that Hierarchical namespace is enabled on the storage account.

​
6. Create a Service Principal

Navigate to User -> Settings -> Identity and access -> Service principals -> Manage. Click Add service principal -> Add new. Choose Databricks managed and provide a name. Open the service principal, click Secrets, choose an expiration period, and Generate. Record both the Client ID and Client Secret — the secret cannot be retrieved later.

​
7. Create the Catalog

Create a new Catalog with Type: Standard and select the storage location created in step 5.

​
8. Grant Permissions to the Service Principal

​
8.1 Catalog Permissions

Navigate to the new catalog and click Permissions -> Grant. Configure:
  • Principals: the service principal from step 6
  • Privilege presets: Data Editor
  • EXTERNAL USE SCHEMA: Enabled

​
8.2 External Location Permissions

Open the external location from step 5. Click Grant, choose the service principal, select ALL PRIVILEGES, and click Confirm.

​
Catalog Information Summary

When the steps above are complete, collect the following values for the StreamNative Ursa compaction service: For the next steps, see Register Lakehouse Catalogs.