1. Provisioning BYOC Infrastructure

Managing your BYOC deployment

StreamNative provides the value of a full-managed Pulsar solution using StreamNative in your cloud account. This is made possible via StreamNative's cloud architecture of a separate control plane and data plane.

With the “Bring Your Own Cloud” (BYOC) deployment, the infrastructure and network are owned by you and managed by StreamNative.

  • You can leverage your own public cloud account (AWS, GCP, and Azure)
  • You have near-zero administration.
  • You maintain security protocols and visibility ito your data.

The following diagram depicts the BYOC architecture of StreamNative Cloud.

image of BYOC architecture

Responsibility model

The responsibilities of using StreamNative BYOC are different from those of using StreamNative Hosted. For the differences across the deployment options of managed cloud, check out the Responsibility Model.

How we set up your cloud environment

Before we can create a cluster using your cloud provider, we need to create two things:

  • Cloud Connection: this is a connection from StreamNative to your Cloud Account. This allows us to provision your Cloud Environment so that we can create your Pulsar Clusters. To create a Cloud Connection, you must first run the StreamNative Vendor Access Terraform Module for your cloud provider. Then, we need to know your provider (AWS, GCP, or Azure) and account ID. We only use the minimum necessary access to set up your Pulsar Clusters - for more information on how we use this connection, please refer to our access model.
  • Cloud Environment: this is an abstract definition of the compute, storage, and networking needed to host Pulsar instances. Once you have provisioned a Cloud Environment, you can create an Instance and Pulsar Cluster within it.

Note

When you create an Instance with snctl, you need to specify a poolRef. This poolRef refers to your Cloud Connection.

BYOC Provisioning FAQs

  • Can I create Cloud Connections from different Cloud Providers? Yes - you can either create multiple Cloud Connections from the same cloud provider if you have multiple accounts with them, or create Cloud Connections from multiple different providers.
  • Can I create multiple Cloud Enivronments in the same region? You cannot create multiple Cloud Environments in the same region using the same Cloud Connection. However, if you are using different Cloud Connections, you may do so.

Supported cloud providers

StreamNative Cloud supports multiple cloud providers, as listed in the table below.

Cloud providerStatusCloud-specific features
AWSGA - Production
  • Private link
  • Tiered Storage to S3
Google CloudGA - Production
  • Tiered Storage to GCS
AzurePublic Preview

For information about deploying StreamNative's BYOC product on AWS:

Previous
Setup Pulsar Clusters