Skip to main content

Documentation Index

Fetch the complete documentation index at: https://docs.streamnative.io/llms.txt

Use this file to discover all available pages before exploring further.

Feature Matrix

FeatureIceberg (SDT)Delta (SDT)Iceberg (SBT)Delta (SBT)
Schema EvolutionSupportedSupportedComing SoonComing Soon
Partition KeyConfigurableConfigurableComing SoonComing Soon
UpsertSupportedSupportedComing SoonComing Soon
Variant TypeSupported (V3)SupportedComing SoonComing Soon
Streaming ReadComing SoonComing Soon
Analytical QuerySupportedSupportedComing SoonComing Soon

Supported Cloud Vendors

ProviderWAL StorageLakehouse Table
AWS S3SupportedSupported
Google Cloud StorageSupportedSupported
Azure Blob StorageSupportedSupported

Supported Schemas

Schema FormatSupported
AvroYes
JSONYes
ProtobufNative (Pulsar)Yes
Protobuf (Kafka)Yes
Supported schema registries:
  • StreamNative Kafka Schema Registry
  • Confluent Schema Registry

Feature Guides

Each feature has its own detailed guide:
  • Schema Evolution — How the lakehouse table evolves when the topic schema changes, including Dead Letter Table (DLT) behavior
  • Variant Type — Handle semi-structured data with Iceberg / Delta Variant type
  • Partition Key — Configure table partitioning with Iceberg transforms
  • Upsert — Deduplication and primary key-based updates
  • Persist Extra Metadata — Persist message-envelope metadata (offset, publish time, properties) as a __meta Variant column
  • Persist Key — Persist the source message key as a __key column

Next Steps

  • Observability — Monitor lakehouse tables with metrics and Grafana dashboards