Create Universal Links in StreamNative Cloud

​

Prerequisites

• You have created a Ursa cluster in your organization. Ensure no data or schema is produced in the Ursa cluster to avoid potential conflicts.

​

Create Data Migration

1. Navigate to the Organization Dashboard.
2. Click Unilink in the left navigation pane to access the UniLink page.
3. Click the Create button at the top right corner and select Data Migration to initiate the job creation process.
4. Enter the Job Name for this UniLink instance. Then click Source & Destination Details to proceed.

​

Source & Destination Cluster Configuration

1. On the Source & Destination Details page, enter the Source Cluster and Destination Cluster information. Provide the URL for the source cluster and select the destination cluster from the dropdown list.
2. If your source cluster has TLS enabled, toggle the Cluster with TLS enabled switch.

​

Topic Configuration

1. On the Topic Configuration page, select the topics you want to migrate from the source cluster to the destination cluster. Choose All topics replications to replicate all topics or Selected topics to replicate specific topics. If you select Selected topics, enter the topic name in the Include topics input box. It supports multiple regex patterns separated by commas, e.g., topic1,topic2,topic3-.*.
2. Enter the Destination prefix for the topics in the destination cluster. The prefix will be added to the topic name in the destination cluster. For example, if the prefix is public/test/, topic1 will be migrated to public/test/topic1. This helps migrate topics to a specific namespace. The prefix must be in the format of tenant/namespace/ or any string ending with an underscore.
3. UniLink will periodically check the source cluster for new topics and automatically migrate them to the destination cluster. Set the Topic refresh interval to specify the interval in seconds for checking new topics.
4. Optionally, enter Excluded topics to exclude certain topics from migration. It supports multiple regex patterns separated by commas, e.g., topic1,topic2,topic3-.*.
5. Click Connect & Deploy. This builds a topic mapping between the source and destination cluster for review. Click Continue to proceed to the next step.

​

Consumer Groups Configuration

1. Enable Enable consumer groups replication to migrate consumer groups.
2. Choose All consumer groups to migrate all consumer groups or Selected consumer groups to migrate specific ones. If you select Selected consumer groups, enter the consumer group name in the Include consumer groups input box. It supports multiple regex patterns separated by commas, e.g., group1,group2,group3-.*.
3. Set the Consumer group refresh interval to specify the interval in seconds for checking new consumer groups.
4. Optionally, enter Excluded consumer groups to exclude certain groups from migration. It supports multiple regex patterns separated by commas, e.g., group1,group2,group3-.*.
5. Click Deploy. This builds a consumer group mapping between the source and destination cluster for review. Click * *Continue** to deploy the UniLink job.

​

Create Schema Migration

1. Navigate to the Organization Dashboard.
2. Click Unilink in the left navigation pane to access the UniLink page.
3. Click the Create button at the top right corner and select Schema Migration to start the job creation process.
4. Enter the Job Name for this UniLink Schema instance. Then click Source & destination Details to proceed.

​

Source & Destination Cluster Configuration

1. On the Source & Destination Details page, enter the Source Cluster and Destination Cluster information. Provide the URL for the source cluster schema registry and select the destination cluster from the dropdown list.
2. Create a secret for the source cluster. Click Create Secret to generate a secret for the source cluster. Enter the API Key and API Secret for the source cluster, then click Create. You can also select an existing secret from the dropdown list.

​

Subjects Configuration

1. On the Subjects Configuration page, select the subjects you want to migrate from the source cluster to the destination cluster. Choose All subjects replication to migrate all subjects or Selected subjects to migrate specific ones. If you select Selected subjects, enter the subject name in the Include subjects input box. It supports multiple regex patterns separated by commas, e.g., subject1,subject2,subject3-.*.
2. Enter the Destination prefix for the subjects in the destination cluster. The prefix will be added to the subject name in the destination cluster. For example, if the prefix is public/test/, subject1 will be migrated to public/test/subject1. This helps migrate subjects to a specific namespace. The prefix must be in the format of tenant/namespace/ or any string ending with an underscore. Ensure this subject mapping configuration is consistent with the topic mapping configuration in the Data Migration job.