Streaming Data Manager

What is Streaming Data Manager?

Cisco Streaming Data Manager (Streaming Data Manager) is the deployment tool for setting up and operating production-ready Apache Kafka clusters on Kubernetes, leveraging a Cloud Native technology stack. Streaming Data Manager includes Zookeeper, Koperator, Envoy, and many other components hosted in a managed service mesh. All components are automatically installed, configured, and managed in order to operate a production-ready Kafka cluster on Kubernetes.

Streaming Data Manager is an optional add-on of Service Mesh Manager.

What are the key features?

  • Designed for Cloud Natives, Streaming Data Manager provides declarative topic and user management through custom resources (CRs), and automates the setup and management of Apache Kafka on Kubernetes. It also allows you to fine-tune the configurations of your brokers individually for heterogeneous cluster layouts.
  • You can deploy managed Kafka in your own environment, including on-premises, cloud, multi-cloud, and hybrid-cloud scenarios. Streaming Data Manager can automatically scale and self-heal your cluster based on Prometheus alerts. To minimize downtime and keep your operations functional, Streaming Data Manager provides rolling upgrades and advanced Grafana dashboards to monitor all Streaming Data Manager components.
  • Our products focus on secure operations, so Streaming Data Manager automatically uses mTLS-based encrypted and authenticated communication between all components. It also provides Kubernetes-native RBAC access control, integration with Kafka ACLs, and supports multi-tenant operation.
  • To keep your services highly availability, you can deploy and manage cross-cluster replication using MirrorMaker2, and also use Kubernetes-native volume snapshots for disaster recovery. Up- and down-scaling your brokers and volumes automatically allows you to use optimal resources for the incoming traffic without manual intervention.

Further information

For further details on Streaming Data Manager, see the Streaming Data Manager documentation and the Streaming Data Manager FAQ.