volumes.data.storageClassName
in the values.yaml
YAML file, the Pulsar operator uses the default storage class.
Use the command below to get the name of the current default storage class:
volumeBindingMode: WaitForFirstConsumer
reclaimPolicy: Retain
allowVolumeExpansion: true
(required field for the production deployments)values.yaml
YAML file.
numVolumes
: the number of volumes supported for each journal.numDirsPerVolume
: the number of directories BookKeeper outputs its Write-Ahead Logs (WAL) to.numVolumes
: the number of volumes supported for each ledger.numDirsPerVolume
: the number of directories BookKeeper outputs ledger snapshots to.broker.offload.enabled=true
. When you enable Tiered Storage, you need to configure the type of blob storage to use and its related properties, such as the bucket / container, the region, and the credentials.
When a Pulsar cluster is deleted, StreamNative Platform does not perform a garbage collection of the Tiered Storage bucket contents. You can either wait for the set deletion interval or manually delete the objects in the Tiered Storage bucket.
To disable Tiered Storage, you can set broker.offload.enabled=false
.
values.yaml
YAML file:
Field | Description | Default | Required or not |
---|---|---|---|
broker.offload.enable | Enable Tiered Storage. | false | Required |
broker.offload.s3.enabled
| Enable Tiered Storage for AWS S3. | false
| Required |
broker.offload.s3.s3ManagedLedgerOffloadBucket
| The AWS S3 bucket. | N/A | Required |
| broker.offload.s3.s3ManagedLedgerOffloadMaxBlockSizeInBytes
| The maximum size of a block that is sent when a multi-block is uploaded to AWS S3. It cannot be smaller than 5 MB. | 64 MB | Required |
| broker.offload.s3.s3ManagedLedgerOffloadReadBufferSizeInBytes
| The block size for each individual read when reading data from AWS S3. | 1 MB | Required |
| broker.offload.s3.s3ManagedLedgerOffloadServiceEndpoint
| An alternative AWS S3 endpoint to connect to (for test purpose). | N/A | Required |
| broker.offload.s3.secret
| The Kubernetes secret that stores the AWS credentials. | N/A | Required |
values.yaml
YAML file:
Field | Description | Default | Required or not |
---|---|---|---|
broker.offload.enable | Enable Tiered Storage. | false | Required |
broker.offload.managedLedgerOffloadDriver
| The offloader driver name, which is case-insensitive. | google-cloud-storage
| Required |
| broker.offload.gcs.enabled
| Enable Tiered Storage for Google GCS. | false
| Required |
| broker.offload.gcs.gcsManagedLedgerOffloadRegion
| The Google Cloud Storage bucket region. | N/A | Required |
| broker.offload.gcs.gcsManagedLedgerOffloadBucket
| The Google Cloud Storage bucket. | N/A | Required |
| broker.offload.gcs.gcsManagedLedgerOffloadMaxBlockSizeInBytes
| The maximum size of a block that is sent when a multi-block is uploaded to Google Cloud Storage. It cannot be smaller than 5 MB. | 64 MB | Optional |
| broker.offload.gcs.gcsManagedLedgerOffloadReadBufferSizeInBytes
| The block size for each individual read when reading data from Google Cloud Storage. | 1 MB | Optional |
| broker.offload.gcs.secret
| The Kubernetes secret that stores the Google credentials. | N/A | Required |
values.yaml
YAML file:
Field | Description | Default | Required or not |
---|---|---|---|
broker.offload.enable | Enable Tiered Storage. | false | Required |
broker.offload.managedLedgerOffloadDriver
| The offloader driver name, which is case-insensitive. | azureblob
| Required |
| broker.offload.azureblob.enabled
| Enable Tiered Storage for Azure Blob Storage. | false
| Required |
| broker.offload.azureblob.managedLedgerOffloadBucket
| The Azure Blob container. | N/A | Required |
| broker.offload.azureblob.managedLedgerOffloadMaxBlockSizeInBytes
| The maximum size of a block that is sent when a multi-block is uploaded to Azure Blob Storage. It cannot be smaller than 5 MB. | 64 MB | Optional |
| broker.offload.azureblob.managedLedgerOffloadReadBufferSizeInBytes
| The block size for each individual read when reading data from Azure Blob Storage. | 1 MB | Optional |
| broker.offload.azureblob.managedLedgerOffloadServiceEndpoint
| An alternative Azure Blob Storage endpoint to connect to (for test purpose). | N/A | Required |
| broker.offload.azureblob.secret
| The Kubernetes secret that stores the Azure credentials. | N/A | Required |