Configuration

Kafka Connect

Access Control

User permissions to Kafka cluster resources are defined by Connect actions.

Configuration

Kpow connects to a Connect cluster with environment variables.

VariableDescription
CONNECT_REST_URLThe client connection URL for your connect cluster
CONNECT_AUTHBASIC if basic authentication is configured
CONNECT_BASIC_AUTH_USERUsername if basic authentication is configured
CONNECT_BASIC_AUTH_PASSPassword if basic authentication is configured
CONNECT_OFFSET_STORAGE_TOPIC(Optional) Topic that holds connect offsets
CONNECT_GROUP_ID(Optional) Unique string identifying worker cluster group
CONNECT_PERMISSIVE_SSLTrue if SSL certificate validation should be disabled
CONNECT_TIMEOUT_MSThe timeout value in ms for all HTTP requests made to a Kafka Connect cluster. Default: 5000
CONNECT_RESOURCE_IDSOptional, comma separated list of unique ids. Only specify when configuring multiple connect clusters

Configuring Multiple Connect Clusters

Kpow supports multiple Kafka Connect clusters associated to a single Kafka cluster.

To configure multiple Kafka Connect clusters, use the environment variable CONNECT_RESOURCE_IDS to define a comma separated list of Connect clusters. Kpow uses the resource ID as a prefix in the environment variable.

Example configuration when configuring two Kafka Connect clusters:

CONNECT_RESOURCE_IDS=US1,EU2
US1_CONNECT_REST_URL=http://us1-connect.mycorp.org:8003
EU2_CONNECT_REST_URL=http://eu2-connect.mycorp.org:8003

In this example we have defined a connection to two Kafka Connect resources: US1 and EU2

Kpow's startup log message confirming it has connected to both Connect clusters.

Multiple Connect Clusters are navigable via the left hand or context menus.

Kpow's navigation menu when multiple Connect clusters have been configured.

Previous
Schema Registry