Native Kafka Clusters are currently available on Dedicated and BYOC deployment models. Serverless support for Kafka Clusters is coming soon.
The capabilities provided in this topic are for planning purposes, and are not a guarantee of performance, which varies depending on each unique configuration.
Serverless Clusters
Serverless clusters are the newest addition to StreamNative Cloud, offering a fully managed, auto-scaling solution with minimal operational overhead. Key features include:- Instant provisioning with a minimum base cost of 1 ETU
- Automatic scaling based on your workload, with billing only for resources used.
- Simplified management with StreamNative handling all infrastructure concerns.
- Ideal for development, testing, and production workloads with variable traffic patterns.
ETU limits per Serverless cluster
Serverless clusters are elastic, shrinking and expanding automatically based on load. You don’t need to size your cluster. When you need more capacity, your Serverless cluster expands up to the fixed maximum. When no capacity is in use, a minimum charge of 1 ETU applies. Serverless cluster capacity
If no capacity is consumed, the system defaults to a minimum billing level of 1 ETU. For more information, see Elastic Throughput Unit (ETU).
ETU capacity guidance
The dimensions in the following table describe the capacity of a single ETU. For more information about ETU, see Elastic Throughput Unit (ETU) and ETU vs CU/SU.Serverless limits per cluster
Serverless limits per partition
The partition capabilities that follow are based on benchmarking and intended as practical guidelines for planning purposes. Performance per partition will vary based on your specific configuration, and these benchmarks do not guarantee performance.Serverless Cloud Providers & Regions
Serverless clusters are currently available in limited regions. Please check the StreamNative Cloud console for the most up-to-date information on available regions.Serverless Features and Usage Limits
Here are some guidelines for the serverless cluster limits:The following max capacity is a guidance. Whether your serverless cluster can reach such capacity depending on the workload, number of topics, number of connections, and etc. If you want more predictable capacity, please contact StreamNative Sales
In addition to the usage limits, there are some additional limitations in features:
- Tiered Storage is transparent, meaning you don’t need to configure it. However, Serverless clusters don’t support bringing your own bucket. If you need to use your own object storage bucket, you should consider using BYOC or BYOC Pro clusters.
- Serverless clusters use Rapid Release Channel by default. You can’t choose a different release channel.
- Auto-scaling is enabled by default. You don’t need to configure it.
- Remote writes to external observability systems are not supported.
- Custom maintenance windows are not available.
- Private networking options are not available.
Dedicated Clusters
Dedicated (formerly Hosted) clusters are fully managed on StreamNative’s cloud infrastructure. They support the following capabilities:- Deployment in supported regions on AWS, GCP, and Azure with a 99.95% uptime SLA for Single-Zone and 99.99% for Multi-Zone.
- Optional multi-zone high availability, spreading a cluster across three availability zones for enhanced resilience.
- Simplified scaling in terms of Compute Units (CUs) and Storage Units (SUs).
- Programmable or automatic scaling options.
Dedicated Pro Offering
StreamNative offers a Pro offering within Dedicated clusters that provides enhanced networking and security capabilities for enterprise workloads. Dedicated Pro includes:- Private Link: Secure private connectivity to your cluster
- VPC/VNet Peering: Connect your cluster to your existing network infrastructure
- Transit Gateway: Advanced network routing and connectivity options
- Remote writes: Send metrics to external observability systems
- Managed Flink: Stream processing capabilities (Private Preview, currently GCP only)
- Bring Your Own Key: Use your own encryption keys for data-at-rest encryption
Dedicated Cloud Providers & Regions
The following is a list of cloud providers along with the regions and zones supported for Dedicated (formerly Hosted) Clusters:AWS
GCP
Azure
If you need to deploy a Dedicated cluster in a region not listed above, contact StreamNative support to discuss your requirements. We may be able to accommodate specific region requests for Dedicated clusters.
Dedicated Features and Usage Limits
The following table outlines the features and usage limits for the Dedicated (formerly Hosted) Clusters:| Type | Features | Capability |
|---|---|---|
| Service | Uptime SLA | 99.95% |
| Multi AZ | 99.99% | |
| Scale | Throughput limit per topic | Max 100 MBps |
| Storage limit per topic | Max 1000 TB | |
| Tenant limit | Max 128 | |
| Namespace limit | Max 1024 | |
| Topic limit | Max 10240 | |
| Cloud providers | GCP | Yes |
| AWS | Yes | |
| Azure | Yes |
- Tiered Storage is transparent, meaning you don’t need to configure it. However, Dedicated clusters don’t support bringing your own bucket. If you need to use your own bucket, you should consider using BYOC or BYOC Pro clusters.
- Remote writes to external observability systems are only available in Dedicated Pro.
- Custom maintenance windows are not available.
- Private networking options (Private Link, VPC/VNet Peering, Transit Gateway) are only available in Dedicated Pro.
BYOC Clusters
BYOC clusters are designed for production-ready deployments in your Cloud account, tailored to meet your data security, compliance, and sovereignty requirements. They offer the following capabilities:- Dedicated deployments in your chosen region within your cloud account (AWS, GCP, Azure) with a 99.5% uptime SLA for Single-Zone and 99.99% for Multi-Zone.
- Private networking options including AWS PrivateLink, Azure PrivateLink, and GCP Private Service Connect.
- Optional multi-zone high availability, spreading a cluster across three availability zones for increased resilience.
- Simplified scaling in terms of CUs and SUs.
- Programmable or automatic scaling options.
- You can choose between Latency Optimized Profile and Cost Optimized Profile.
BYOC Cloud Providers & Regions
A BYOC cluster can be deployed in any selected region in your cloud account across AWS, GCP, and Azure.BYOC Features and Usage Limits
- The performance limit is majorly bound by the underlying resources of your cloud account.
- You can use your own S3-compatible storage bucket for the clusters with Cost Optimized Profile or Lakehouse tiered storage for the clusters with Latency Optimized Profile.
- You can use your own keys for data-at-rest encryption.
- Only PrivateLink is supported for private networking. Other private networking options are not supported. You can manually configure them if you choose to use a different private networking option, but it will be out of scope for StreamNative support.
- Geo-replication via private networking is not supported. Only public networking geo-replication is supported. If you need geo-replication via private networking, you should consider using BYOC Pro.
- Remote writes to external observability systems are not supported.
- Custom maintenance windows are not available.
- Bring Your Own Network (BYON) is not supported. Only StreamNative-managed VPCs are available.
- Custom DNS (Bring Your Own Domain) is not supported.
ETU capacity guidance
The dimensions in the following table describe the capacity of a single ETU in a BYOC cluster. For more information about ETUs, see Elastic Throughput Unit (ETU) and ETU vs CU/SU.BYOC Pro Clusters
BYOC Pro Clusters are designed for critical production workloads and offer enhanced security and networking features, including:- Advanced private networking options like VPC/VNet Peering and Transit Gateway.
- Remote writes to external observability systems.
- Self-managed keys (Bring-Your-Own-Key) for AWS, Azure, or GCP.
- Bring Your Own Network (BYON) — use your own VPC/VNet instead of a StreamNative-managed VPC.
- Custom DNS (Bring Your Own Domain) — use your own DNS zone for cluster endpoints.
Lakehouse tiered storage is available in both BYOC standard and BYOC Pro clusters, allowing you to use your own S3-compatible storage bucket for the Cost Optimized Profile or Lakehouse tiered storage for the Latency Optimized Profile.
BYOC Pro Cloud Providers & Regions
BYOC Pro Clusters can be deployed in any selected region in your cloud account across AWS, GCP, and Azure.BYOC Pro Features and Usage Limits
BYOC Pro is the most secure and flexible option, which provides you with full control over your data and network configurations.- The performance limit is majorly bound by the underlying resources of your cloud account.
- You can use your own S3-compatible storage bucket for the clusters with Cost Optimized Profile or Lakehouse tiered storage for the clusters with Latency Optimized Profile.
- You can use your own keys for data-at-rest encryption.
- Private Link, VPC/VNet Peering, and Transit Gateway are supported for private networking.
- Geo-replication via private networking is supported.