Topics dashboard

The MENU > TOPICS page on the Streaming Data Manager web interface shows information about your Kafka topics.

If you have multiple Apache Kafka clusters, select the one to show from the CLUSTER field.

The summary bar gives you an overview of the topics in the cluster, displaying the following information.

• Topics: The total number of topics in the cluster.
• Partitions: The total number of partitions in the cluster.
• URP: The number of under-replicated partitions.
• Without leader: The total number of partitions without a leader.
• Under min ISR: Number of partitions under minimum in-sync replication number.

For each topic, Streaming Data Manager displays the following information. Click on a topic to display its details.

• TOPIC NAME: The name of the topic.
• REPLICATION FACTOR: The replication factor of the topic.
• PARTITIONS: The number of partitions for the topic.
• MESSAGE COUNT: The number of messages in the topic.
• IN / OUT BYTES: The total amount of incoming and outgoing traffic.
• SIZE (CURRENT / LIMIT): The current size of the topic and the maximal configured size of the topic. If the size retention is not configured and the maximum size is not limited, an infinity (∞) sign (∞) is displayed.
• CONSUMERS: The number of consumers for the topic.
• SPREAD: The percentage of brokers in the cluster that have partitions for the given topic.
• TAGS: Shows if the topic is hidden, compacted, or both. By default, such topics are not visible. To list such topics,click the TAGS column and select them.

Find a topic

• To find a specific topic, use the Search field.
• To also list topics having a specific tag, or set of tags, click the TAGS column to select them.

Export topic list

To export the data of the current page in CSV or JSON format, click .

Topic details

The details view of the topic displays the following information.

• MESSAGE COUNT: The number of messages in the topic.
• COMPACTED: Whether the topic has been compacted or not.
• PARTITIONS: The number of partitions for the topic.
• REPLICATION FACTOR: The replication factor of the topic.
• Minimum ISR: Minimum in-sync replication number.

• Click PARTITIONS to display the details of the partitions belonging to the topic.
• Click CONSUMER GROUPS to display the details of the consumers of the topic.

To export the data of the current page in CSV or JSON format, click .

Partition details of a topic

Click MENU > TOPICS > <TOPIC-NAME> > PARTITIONS to display the details of the partitions belonging to the topic. The following information is displayed.

• ID: The ID of the partition.
• LEADER: The ID of the leader Kafka server of the partition.
• OFFSET: Lowest and highest available offsets (low watermark / high watermark).
• SIZE: The size of the partition.
• ISR: The number of replicas that are in-sync.
• REPLICAS: The number of replicas for the topic.

To export the data of the current page in CSV or JSON format, click .

Consumer groups of a topic

Click MENU > TOPICS > <TOPIC-NAME> > CONSUMER GROUPS to display the details of the consumers of a topic. The following information is displayed.

• CONSUMER GROUP: The name of the consumer group reading the topic.
• STATE: The state of the consumer group, for example, Active.
• OVERALL LAG: The lag of the consumer group compared to the topic.
• MEMBERS: The number of members in the consumer group.

To export the data of the current page in CSV or JSON format, click .