Create KafkaCluster using the CLI
To create a Kafka cluster using the CLI, run the following commands.
-
Verify that Zookeeper is installed on the cluster.
kubectl get pods -n zookeeper
If the Zookeeper is not installed, run:
smm sdm zookeeper install
If you want to install Zookeeper using GitOps methods, see Deploy ZooKeeper cluster application.
-
Create a Kafka cluster.
smm sdm cluster create
This command creates the following resources:
-
A service account called kafka-cluster, which is used by the Kafka broker pods.
-
A KafkaCluster custom resource with:
- 2 Kafka brokers
- 2 internal listeners (port: 29092, 29093)
- The name of the service depends on the KafkaCluster.spec.headlessServiceEnabled value. If the boolean value
KafkaCluster.spec.headlessServiceEnabled
istrue
then the service iskafka-headless:29092
elsekafka-all-broker:29092
(load balancing takes place at this address).
- The name of the service depends on the KafkaCluster.spec.headlessServiceEnabled value. If the boolean value
- 10GB broker log dir storage
- Zookeeper address: zookeeper-server-client.zookeeper:2181
-
-
Verify that the Kafka cluster is running.
smm sdm cluster get
The output should look similar to:
Namespace Name State Image Alerts Cruise Control Topic Status Rolling Upgrade Errors Rolling Upgrade Last Success kafka kafka ClusterRunning ghcr.io/banzaicloud/kafka:2.13-3.1.0 0 CruiseControlTopicReady 0 2023-01-31 20:17:25