Overview

StreamNative Platform is a cloud-native messaging and event-streaming platform that enables you to build a real-time application and data infrastructure for both real-time and historical events. Founded by the original developers of Apache Pulsar and Apache BookKeeper, StreamNative offers a complete, self-managed platform for continuously streaming data across your organization to power rich customer experiences and data-driven operations. You can deploy StreamNative Platform on-premise or in-cloud.

Powered by Apache Pulsar, StreamNative Platform makes it easy to build mission-critical messaging and streaming applications and real-time data pipelines by integrating data from multiple sources into a single, central messaging and event streaming platform for your company. StreamNative Platform lets you focus on how to maximize business value from real-time data rather than worrying about the underlying mechanisms such as how data is messaged between various systems and how data is stored reliably for processing.

Specifically, StreamNative Platform simplifies:

• Publishing-and-consuming messages using popular messaging protocols (including Apache Pulsar and Apache Kafka)
• Connecting various data sources to Pulsar
• Building real-time applications with Pulsar
• Integrating your data processing infrastructure with Pulsar
• Securing, monitoring, and managing your Pulsar deployments

Most importantly, StreamNative Platform enables you to:

• Deploy and manage Pulsar in your private cloud environment
• Deploy and manage your platform as a cloud-native system on Kubernetes
• Monitor the health and performance of Pulsar clusters using dedicated tools such as Pulsar detector and StreamNative console.

Out of the box, the latest features of Pulsar and the add-on StreamNative features are shipped in each StreamNative Platform release.

Why use StreamNative Platform?

With StreamNative Platform, you can enjoy the following benefits:

• Infinite productivity: Empower more developers to use Pulsar and improve the efficiency to build event streaming applications.

• Efficient operations at scale: Minimize operational complexity and ensure high performance and scalability as event streaming grows in your organization.

• Production-stage: Implement event streaming in production with enterprise-level functionalities.

• Flexible deployment: Deploy on-premises, in private or public cloud, from bare-metal to Kubernetes, or leverage a fully managed cloud service with StreamNative Platform.

• Committer-driven expertise: Leverage the rich experience of Pulsar experts and committers to support you throughout the application development lifecycle.

What is Apache Pulsar

At the core of StreamNative Platform is Apache Pulsar, an open source distributed cloud-native messaging and streaming platform.

The key capabilities of Apache Pulsar are:

• Publish and subscribe to event streams at scale
• Store infinite event streams in a reliable and scalable way with Apache BookKeeper and tiered storage
• Process and query event streams using serverless functions

Apache Pulsar has received global adoption from major technology companies such as Verizon Media, Narvar, Overstock, Nutanix, Yahoo! JAPAN, Tencent, OVHCloud, and Clever Cloud, who rely on its ability to deliver on performance, scalability, and resiliency. Pulsar adoption is driven by the market's increased demand for real-time, data-enabled technologies, from asynchronous applications to core business applications to ETL.

The key components of Pulsar are:

• Brokers

  Brokers form the messaging and serving tier for Pulsar.

• Bookies

  Bookies form the storage tier for Pulsar.

• Functions Workers

  Functions Workers form the serverless processing tier for Pulsar.

• Proxy

  Pulsar proxy is an optional gateway that you can run in front of the brokers in a Pulsar cluster.

• ZooKeeper

  Pulsar relies on ZooKeeper for a wide variety of configuration-related and coordination-related tasks.

• Client APIs

  • Producer API: allows an application to publish a stream of events to one or more Pulsar topics.
  • Consumer API: allows an application to subscribe to one or more topics and receive the stream of events produced to them.
  • Functions API: allows an application to create, deploy, and manage serverless functions that consume events from one or more Pulsar topics, apply a user-supplied processing logic to each event, and publish the results of the computation to another topic.
  • Connector API: allows an application to create, deploy, and manage connectors that interact with external systems, such as Apache Cassandra, Aerospike, and many others.
  • Admin API: allows an application to manage Pulsar resources (for example, namespaces, topics, functions, connectors, and so on) in a programmable way.

StreamNative Platform vs Apache Pulsar

Each release of StreamNative Platform includes the latest release of Pulsar as well as additional tools and services that make it easier to build and manage a cloud-native messaging and event-streaming platform. StreamNative Platform delivers both community and enhanced features that complement and enhance your Pulsar deployment.

The following table lists features supported in Apache Pulsar and StreamNative Platform.

Get started with StreamNative Platform.

Next Steps

• Follow the Platform QuickStart.
• Review Pulsar Fundamentals.