Kafka Connect
Create and Control Connectors and Tasks with kPow

Access Control

User permissions to Kafka cluster resources are defined by Connect actions.

Configuration

kPow connects to a Connect cluster with environment variables.
Variable
Description
CONNECT_REST_URL
The client connection URL for your connect cluster
CONNECT_AUTH
BASIC if basic authentication is configured
CONNECT_BASIC_AUTH_USER
Username if basic authentication is configured
CONNECT_BASIC_AUTH_PASS
Password if basic authentication is configured
CONNECT_OFFSET_STORAGE_TOPIC
(Optional) Topic that holds connect offsets
CONNECT_GROUP_ID
(Optional) Unique string identifying worker cluster group
CONNECT_PERMISSIVE_SSL
True if SSL certificate validation should be disabled
CONNECT_TIMEOUT_MS
The timeout value in ms for all HTTP requests made to a Kafka Connect cluster. Default: 5000
CONNECT_RESOURCE_IDS
Optional, comma separated list of unique ids. Only specify when configuring multiple connect clusters

Configuring Multiple Connect Clusters

kPow supports multiple Kafka Connect clusters associated to a single Kafka cluster.
To configure multiple Kafka Connect clusters, use the environment variable CONNECT_RESOURCE_IDS to define a comma separated list of Connect clusters. kPow uses the resource ID as a prefix in the environment variable.
Example configuration when configuring two Kafka Connect clusters:
1
CONNECT_RESOURCE_IDS=US1,EU2
2
US1_CONNECT_REST_URL=http://us1-connect.mycorp.org:8003
3
EU2_CONNECT_REST_URL=http://eu2-connect.mycorp.org:8003
Copied!
In this example we have defined a connection to two Kafka Connect resources: US1 and EU2
kPow's startup log message confirming it has connected to both Connect clusters.
Multiple Connect Clusters are navigable via the left hand or context menus.
kPow's navigation menu when multiple Connect clusters have been configured.
Last modified 3mo ago