The Ultimate Engineering Toolkit for Apache Kafka®

Kafka Connect

Create and Control Connectors and Tasks with kPow

Access Control
User permissions to Kafka cluster resources are defined by Connect actions. 
Configuration
kPow connects to a Connect cluster with environment variables.
Variable
Description
CONNECT_REST_URL
The client connection URL for your connect cluster
CONNECT_AUTH
BASIC if basic authentication is configured
CONNECT_BASIC_AUTH_USER
Username if basic authentication is configured
CONNECT_BASIC_AUTH_PASS
Password if basic authentication is configured
CONNECT_OFFSET_STORAGE_TOPIC
(Optional) Topic that holds connect offsets
CONNECT_GROUP_ID
(Optional) Unique string identifying worker cluster group
CONNECT_PERMISSIVE_SSL
True if SSL certificate validation should be disabled
CONNECT_TIMEOUT_MS
The timeout value in ms for all HTTP requests made to a Kafka Connect cluster. Default: 5000
CONNECT_RESOURCE_IDS
Optional, comma separated list of unique ids. Only specify when configuring multiple connect clusters​
Configuring Multiple Connect Clusters
kPow supports multiple Kafka Connect clusters associated to a single Kafka cluster. 
To configure multiple Kafka Connect clusters, use the environment variable CONNECT_RESOURCE_IDS to define a comma separated list of Connect clusters. kPow uses the resource ID as a prefix in the environment variable.
Example configuration when configuring two Kafka Connect clusters:
CONNECT_RESOURCE_IDS=US1,EU2
US1_CONNECT_REST_URL=http://us1-connect.mycorp.org:8003
EU2_CONNECT_REST_URL=http://eu2-connect.mycorp.org:8003
In this example we have defined a connection to two Kafka Connect resources: US1 and EU2
kPow's startup log message confirming it has connected to both Connect clusters.
Multiple Connect Clusters are navigable via the left hand or context menus.
kPow's navigation menu when multiple Connect clusters have been configured.
​
​
​
​

Configuration - Previous

Schema Registry

Next - Configuration

Multi-Cluster Management

Last updated 4 weeks ago

Variable	Description
CONNECT_REST_URL	The client connection URL for your connect cluster
CONNECT_AUTH	BASIC if basic authentication is configured
CONNECT_BASIC_AUTH_USER	Username if basic authentication is configured
CONNECT_BASIC_AUTH_PASS	Password if basic authentication is configured
CONNECT_OFFSET_STORAGE_TOPIC	(Optional) Topic that holds connect offsets
CONNECT_GROUP_ID	(Optional) Unique string identifying worker cluster group
CONNECT_PERMISSIVE_SSL	True if SSL certificate validation should be disabled
CONNECT_TIMEOUT_MS	The timeout value in ms for all HTTP requests made to a Kafka Connect cluster. Default: 5000
CONNECT_RESOURCE_IDS	Optional, comma separated list of unique ids. Only specify when configuring multiple connect clusters