What’s Changed
🚀 New Features
Istio Ambient Mode Support
- Ambient Mode Integration: Added comprehensive support for running Pulsar clusters in Istio ambient mode
- API Support: New API configuration for enabling ambient mode in Pulsar clusters
- Service Mesh: Enhanced service mesh capabilities with ambient mode support for improved performance and reduced resource overhead
Agent Function Enhancements
- Session Mode Support: Added session mode support for Agent Functions with enhanced configuration options
- MCP Server Support: Support for multiple MCP (Model Context Protocol) servers in Orca engine
- Configurable Agent Functions: Made agent function configurations customizable through AgentFunction CRD
- MCP Streamable HTTP Config: Added McpStreamableHttpConfig configuration for Agent Functions
- Manifest Generation: Automatic manifest generation for agent_function resources
Pulsar Functions Worker
- Individual Deployment: New PulsarFunctionsWorker CRD to support individual deployment of Functions Worker
- Custom Configuration: Enhanced configuration and dependencies management for individual Functions Worker instances
- Resource Management: Improved resource allocation and management for Functions Worker pods
Multi-Catalog Support
- Multiple Catalogs: Support for multiple catalogs in compaction scheduler and storage catalog
- S3Table Catalog: Added support for appending S3Table catalog configurations
- Catalog Management: Enhanced catalog list checking and validation
- Cluster-Level Catalog: Fixed catalog enabled flag on cluster level configuration
Compaction Service Enhancements
- Cluster Name Support: Introduced clusterName configuration for compaction service
- StatefulSet Deployment: Added configuration support for compaction StatefulSet deployment
- Skip Pause Rollout: Support for compaction scheduler to skip pause during rollout operations
- Status Synchronization: Fixed compaction status synchronization on StatefulSet deployment
UniLink Improvements
- Linking Mode: Added linkingMode configuration for UniLink
- Topic Rename Map: Support for TopicRenameMap configuration in UniLink
- Subject Rename Map: Added subjectRenameMap support for UniLinkSchema
Ultra Low Latency Profile
- Performance Profile: New ultra low latency configuration profile for optimized low-latency workloads
- Tuned Settings: Pre-configured settings for minimal latency operations
🔧 Enhancements
Kafka Connect
- Passthrough Config: Support for passthrough Kafka client configurations in KafkaConnect
- RBAC Support: Enabled Kafka RBAC for versions > 4.0.5.0
- Client Configuration: Enhanced flexibility in Kafka client configuration management
Graceful Rollout
- Token Authentication: Support for token authentication in graceful rollout process
- HPA Integration: Fixed HPA (Horizontal Pod Autoscaler) when graceful rollout is enabled
- Token Parameters: Fixed token parameters handling for graceful rollout operations
- Storage Catalog: Fixed graceful rollout for storage catalog retrieval
Monitoring & Observability
- Full Metrics: Support for full metrics collection and reporting
- API Key Integration: Disable full metrics if API key is not enabled
- Istio Resource Naming: Fixed Istio resource naming for full metrics
- Autorecovery Probes: Added liveness and readiness probes for autorecovery service
Tiered Storage
- Ursa Lakehouse: Support for enabling ursa-lakehouse in environment when lakehouse is enabled
- Managed Ledger Offload: Added managed ledger offload deletion lag milliseconds configuration
- Storage Configuration: Fixed tiered storage configuration with ursa-lakehouse support
Resource Management
- Prepare Container: Added securityContext and resource limits for prepare container
- Function Mesh Resources: Added resource configuration for function mesh components
- BookKeeper Storage: Added PVC and VolumeMount support for BookKeeper when stream storage is enabled
Authentication & Authorization
- Original Auth Data: Added authenticateOriginalAuthData configuration for authentication
- Unity OAuth2: Adjusted Unity for Iceberg OAuth2 authentication configuration
- Broker Token: Support for reading broker authentication tokens from file mounts in SN Agent
Gateway Configuration
- TLS Fields: Introduced feature flag DISABLE_AUTO_FILL_UP_GATEWAY_TLS_FIELDS for gateway TLS configuration
- Proxy Status: Fixed proxy status check when TLS is disabled
- Readonly FS Script: Fixed proxy readonly filesystem script
🐛 Bug Fixes
Core Fixes
- Virtual Hosts Order: Fixed virtual_hosts order in EnvoyFilters for proper routing
- Catalog List Check: Fixed catalog list validation and checking logic
- Catalog Enabled Flag: Fixed catalog enabled flag on cluster level configuration
- Iceberg Suffix: Fixed Iceberg suffix handling in catalog configurations
Component-Specific Fixes
- Function Worker Config: Fixed CustomWorkerConfig not working issue for Functions Worker
- Compaction Status: Fixed compaction status not synchronizing on StatefulSet deployment with nil checks
- Proxy Status: Fixed proxy status check when TLS is disabled
- MCP Headers: Fixed MCP headers for AgentFunctions
Infrastructure Fixes
- E2E Tests: Fixed failed e2e tests and improved test stability
- MySQL Image: Fixed Bitnami MySQL image usage in e2e tests (switched to bitnami/legacy/mysql)
- CI/CD: Fixed Bitnami image changes in CI pipeline
- Test Stability: Improved overall test stability and reliability
🔒 Security Updates
CVE Fixes
- Go Version Upgrade: Upgraded Go to version 1.23.12 to address CVE-2025-47907
- Security Patches: Applied latest security patches and updates
Authentication Enhancements
- Token Security: Enhanced token authentication and management
- OAuth2 Configuration: Improved OAuth2 authentication configuration for Unity Iceberg
- RBAC: Enabled Kafka RBAC for enhanced security in Kafka-on-Pulsar deployments
📦 Dependencies
Updated Dependencies
- Function Mesh: Bumped function-mesh to v0.21.8 for improved functionality
- PFSQL Gateway: Updated PFSQL gateway to version 0.22.6
- PFSQL: Bumped PFSQL to version 0.22.5
Go Module Updates
- Go Version: Upgraded to Go 1.23.12 for security and performance improvements
- Function Worker Dependencies: Updated configuration and dependencies for individual Functions Worker
🚨 Breaking Changes
Configuration Changes
- Gateway TLS Fields: New feature flag DISABLE_AUTO_FILL_UP_GATEWAY_TLS_FIELDS changes gateway TLS field auto-fill behavior
- Catalog Configuration: Multi-catalog support requires updated catalog configuration structure
- Agent Function Config: Agent Function configuration structure has been enhanced with new options
API Changes
- PulsarFunctionsWorker CRD: New CRD introduced for individual Functions Worker deployment
- Ambient Mode API: New API fields added for Istio ambient mode support
- UniLink Configuration: Enhanced UniLink configuration with new linkingMode and TopicRenameMap fields
🔄 Migration Notes
From v0.12.14 to v0.13.6
- Catalog Configuration: Review and update catalog configurations if using multi-catalog features
- Agent Functions: Update Agent Function configurations to leverage new session mode and MCP server support
- Functions Worker: Consider migrating to individual PulsarFunctionsWorker CRD for better isolation
- Gateway TLS: Review gateway TLS configuration if using DISABLE_AUTO_FILL_UP_GATEWAY_TLS_FIELDS feature
- Istio Ambient Mode: If enabling ambient mode, ensure Istio ambient mode is properly configured in your cluster
- Dependencies: Ensure Kubernetes cluster supports the updated dependencies and Go runtime
📋 Upgrade Instructions
- Backup: Create a backup of your current configuration and state
- Update CRDs: Apply the new CRD definitions including PulsarFunctionsWorker
- Update Operator: Deploy the new operator version (v0.13)
- Review Configurations: Review and update configurations for new features (ambient mode, multi-catalog, etc.)
- Verify: Check that all components are running correctly
- Test: Validate new features in a test environment before production use
- Monitor: Monitor metrics and logs for any issues during and after upgrade
🎯 Performance Improvements
- Ultra Low Latency: New profile optimized for minimal latency workloads
- Resource Efficiency: Improved resource allocation for prepare containers and function mesh
- Status Synchronization: Faster and more reliable status synchronization for compaction service
- Catalog Management: Optimized catalog list checking and validation
📚 Documentation
- Updated API documentation for PulsarFunctionsWorker CRD
- Enhanced configuration examples for Istio ambient mode
- Improved guides for multi-catalog configuration
- Added documentation for Agent Function session mode and MCP server support
- Updated troubleshooting guides for common issues