Multi-Cluster Management
Manage Multiple Kafka Resources from One kPow Instance
Multi-cluster does not mean multi-region, install kPow in proximity to your Kafka resources.
One instance of kPow can manage multiple Apache Kafka clusters (and their associated resources).
kPow Switch Clusters UI
When configuring multiple clusters, the first configured cluster is your primary cluster.
The primary cluster holds the kPow internal topics. You can switch the primary cluster at any time.

Resources

kPow will manage as many clusters as your license permits - you may have to increase the memory and CPU to ensure that the regular snapshotting process executes within thirty seconds.
Information on snapshotting performance of each cluster is available at 'settings -> performance'.

Configuration

To configure multiple clusters, simply repeat the connection configuration with _2, _3, _4 suffixes.
ENVIRONMENT_NAME for each resource-set is displayed in the kPow UI when switching cluster.
1
# Cluster 1, Vanilla Apache Kafka
2
3
ENVIRONMENT_NAME=Trade Book (Staging)
4
BOOTSTRAP=kafka-1:19092,kafka-2:19093,kafka-3:19094
5
SECURITY_PROTOCOL=SASL_PLAINTEXT
6
SASL_MECHANISM=PLAIN
7
SASL_JAAS_CONFIG=org.apache.kafka.common.security.plain.PlainLoginModule required username="admin" password="admin-secret";
8
9
# Cluster 2, Confluent Cloud + Schema Registry
10
11
ENVIRONMENT_NAME_2=Outbound Payments (Staging)
12
BOOTSTRAP_2=pkc-1234.us-east-1.aws.confluent.cloud:9092
13
SECURITY_PROTOCOL_2=SASL_SSL
14
SASL_MECHANISM_2=PLAIN
15
SASL_JAAS_CONFIG_2=org.apache.kafka.common.security.plain.PlainLoginModule required username="..." password="...";
16
SSL_ENDPOINT_IDENTIFICATION_ALGORITHM_2=https
17
SCHEMA_REGISTRY_URL_2=https://psrc-1234.us-east-2.aws.confluent.cloud
18
SCHEMA_REGISTRY_AUTH_2=USER_INFO
19
SCHEMA_REGISTRY_USER_2=...
20
SCHEMA_REGISTRY_PASSWORD_2=...
21
22
# Cluster 3, etc.ENVIRONMENT_NAME_3=...
Copied!
Last modified 4mo ago
Copy link