Runbook

Kafka topic offset decreased incident.

Back to Runbooks

Overview

This type of incident occurs when the offset of a Kafka topic decreases unexpectedly. In Kafka, an offset is a unique identifier that represents the position of a message within a partition. When the offset decreases, it means that some messages have been lost or deleted, which can cause data inconsistencies or other issues within the system. This incident type is critical for Kafka-based systems as it affects data integrity and can lead to data loss.

Parameters

Debug

1. Check if the Kafka broker is running

2. Check if the topic exists

3. Check if the consumer is running

4. Check if the consumer is lagging behind

5. Check if the topic has any messages

6. Check the offset for the consumer

9. Check if any partition is under-replicated

Repair

Increase the replication factor of the Kafka topic to prevent data loss and ensure that data is not lost in the event of an offset decrease.

Check the configuration settings of the Kafka topic to make sure that the offset is not set to decrease automatically. If this is the case, change the configuration setting to prevent automatic decreases in the future.

Learn more

Related Runbooks

Check out these related runbooks to help you debug and resolve similar issues.