Kafka Connect

Access Control

User permissions to Kafka cluster resources are defined by Connect actions.


Kafka Connect

The following connects to a standard Kafka Connect cluster using the standard REST API.

Kpow connects to a Connect cluster with environment variables.

CONNECT_REST_URLThe client connection URL for your connect cluster
CONNECT_AUTHBASIC if basic authentication is configured
CONNECT_BASIC_AUTH_USERUsername if basic authentication is configured
CONNECT_BASIC_AUTH_PASSPassword if basic authentication is configured
CONNECT_OFFSET_STORAGE_TOPIC(Optional) Topic that holds connect offsets
CONNECT_GROUP_ID(Optional) Unique string identifying worker cluster group
CONNECT_PERMISSIVE_SSLTrue if SSL certificate validation should be disabled
CONNECT_TIMEOUT_MSThe timeout value in ms for all HTTP requests made to a Kafka Connect cluster. Default: 5000
CONNECT_RESOURCE_IDSOptional, comma separated list of unique ids. Only specify when configuring multiple connect clusters

Confluent Cloud Managed Connect

To configure Confluent Cloud's managed connect view this guide.

MSK Connect

To configure Amazon's MSK connect view this guide.

Configuring Multiple Connect Clusters

Kpow supports multiple Kafka Connect clusters associated to a single Kafka cluster.

To configure multiple Kafka Connect clusters, use the environment variable CONNECT_RESOURCE_IDS to define a comma separated list of Connect clusters. Kpow uses the resource ID as a prefix in the environment variable.

Example configuration when configuring two Kafka Connect clusters:


In this example we have defined a connection to two Kafka Connect resources: US1 and EU2

Kpow's startup log message confirming it has connected to both Connect clusters.

Multiple Connect Clusters are navigable via the top context menus.

Kpow's navigation menu when multiple Connect clusters have been configured.

Schema Registry