---
id: 189c2dc4-7a64-40eb-8647-22ffc94642a4
---

# Kafka Consumer Offset Commit Timeout.
---

This incident type refers to a situation where a Kafka consumer is unable to commit offsets within the specified timeout period. When a consumer receives messages from a Kafka topic, it needs to commit the offset of the last processed message to ensure that it doesn't consume the same messages again. However, if the consumer takes too long to commit the offset, it can cause delays and disrupt the normal functioning of the system. This can happen due to various reasons such as network issues, slow processing, or resource constraints.

### Parameters
```shell
export KAFKA_BROKER="PLACEHOLDER"

export CONSUMER_GROUP="PLACEHOLDER"

export PORT="PLACEHOLDER"

export NEW_TIMEOUT_DURATION_IN_MS="PLACEHOLDER"

export PATH_TO_KAFKA_DIRECTORY="PLACEHOLDER"

export PATH_TO_CONSUMER_CONFIG_FILE="PLACEHOLDER"
```

## Debug

### Step 1: Check if Kafka is running
```shell
systemctl status kafka
```

### Step 2: Check the Kafka topic and partition being consumed
```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP}
```

### Step 3: Check the offset lag for the Kafka topic and partition being consumed
```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP} | awk '{print $1,$6}'
```

### Step 5: Check if the Kafka consumer is committing offsets
```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP} | awk '{print $1,$5}'
```

### Step 6: Check the Kafka logs for any errors or warnings related to offsets
```shell
journalctl -u kafka | grep offset
```

## Repair

### Increase the timeout duration for Kafka Consumer Offset Commit.
```shell


#!/bin/bash



# Set the variables

KAFKA_HOME=${PATH_TO_KAFKA_DIRECTORY}

CONSUMER_CONFIG=${PATH_TO_CONSUMER_CONFIG_FILE}

TIMEOUT_DURATION=${NEW_TIMEOUT_DURATION_IN_MS}



# Update the consumer configuration with the new timeout duration

sed -i "s/offsets.commit.timeout.ms=.*/offsets.commit.timeout.ms=$TIMEOUT_DURATION/g" $CONSUMER_CONFIG



# Restart the Kafka Consumer service

$KAFKA_HOME/bin/kafka-consumer-service restart



# Check the status of the Kafka Consumer service

$KAFKA_HOME/bin/kafka-consumer-service status


```

This incident type refers to a situation where a Kafka consumer is unable to commit offsets within the specified timeout period. When a consumer receives messages from a Kafka topic, it needs to commit the offset of the last processed message to ensure that it doesn't consume the same messages again. However, if the consumer takes too long to commit the offset, it can cause delays and disrupt the normal functioning of the system. This can happen due to various reasons such as network issues, slow processing, or resource constraints.


```shell
export KAFKA_BROKER="PLACEHOLDER"

export CONSUMER_GROUP="PLACEHOLDER"

export PORT="PLACEHOLDER"

export NEW_TIMEOUT_DURATION_IN_MS="PLACEHOLDER"

export PATH_TO_KAFKA_DIRECTORY="PLACEHOLDER"

export PATH_TO_CONSUMER_CONFIG_FILE="PLACEHOLDER"
```


### Step 1: Check if Kafka is running

```shell
systemctl status kafka
```

### Step 2: Check the Kafka topic and partition being consumed

```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP}
```

### Step 3: Check the offset lag for the Kafka topic and partition being consumed

```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP} | awk '{print $1,$6}'
```

### Step 5: Check if the Kafka consumer is committing offsets

```shell
kafka-consumer-groups --bootstrap-server ${KAFKA_BROKER}:${PORT} --describe --group ${CONSUMER_GROUP} | awk '{print $1,$5}'
```

### Step 6: Check the Kafka logs for any errors or warnings related to offsets

```shell
journalctl -u kafka | grep offset
```


### Increase the timeout duration for Kafka Consumer Offset Commit.

```shell


#!/bin/bash



# Set the variables

KAFKA_HOME=${PATH_TO_KAFKA_DIRECTORY}

CONSUMER_CONFIG=${PATH_TO_CONSUMER_CONFIG_FILE}

TIMEOUT_DURATION=${NEW_TIMEOUT_DURATION_IN_MS}



# Update the consumer configuration with the new timeout duration

sed -i "s/offsets.commit.timeout.ms=.*/offsets.commit.timeout.ms=$TIMEOUT_DURATION/g" $CONSUMER_CONFIG



# Restart the Kafka Consumer service

$KAFKA_HOME/bin/kafka-consumer-service restart



# Check the status of the Kafka Consumer service

$KAFKA_HOME/bin/kafka-consumer-service status


```


Kafka Consumer Offset Commit Timeout.

Overview

Parameters

Debug

Step 1: Check if Kafka is running

Step 2: Check the Kafka topic and partition being consumed

Step 3: Check the offset lag for the Kafka topic and partition being consumed

Step 5: Check if the Kafka consumer is committing offsets

Repair

Increase the timeout duration for Kafka Consumer Offset Commit.

Learn more

Related Runbooks

Support