Usage

Groups

Prerequisites

Managing Offsets

Overview

Within Kpow you can change consumer group offsets from any dimension:

  • Whole group assignments
  • Host-level assignments
  • Topic-level assignments
  • Partition-level assignment

Offsets can be reset in multiple ways:

  • By offset value
  • To the earliest offset
  • By time
  • By skipping an offset (eg, incrementing the current offset)

Offset actions

Group offset management can be found in the navigation menu under the Compute menu item.

Select the consumer group you would like to manage from the dropdown, and you will see the consumer group topology.

All offset management actions are available when clicking on a node:

Managing offsets for consumer group: connect-SnapshotSink

Once you have selected a node, the available group offset actions can be found under the Mutations section on the right-hand pane.

Resetting member offsets by time

Scheduling a mutation

All group offset actions are scheduled, and will be invoked once all prerequisites have been met. For group offsets, the prerequisite is that the consumer group's state must be EMPTY. That is, you will have to manually scale down all instances of the consumer group to alter their offsets. This is because group actions cannot be performed on a running consumer group.

By default, Kpow will try to run the mutation for up to 15 minutes after it has been scheduled. You can cancel the mutation or view its current status by clicking on the Mutations tab.

Scheduling a mutation