docker - Kafdrop - 无法使用 bitnami/kafka 连接到 Kafka 集群设置
问题描述
我使用 bitnami kafka 和 zookeeper 设置了一个 kafka 集群,我想查看这个集群或至少一个使用 kafdrop 的代理。我使用 docker compose 来构建所有组件。我最初遵循本教程,然后在 docker-compose.yml 中添加了 kafdrop 配置
version: '2'
networks:
kafka-net:
driver: bridge
services:
zookeeper-server:
image: 'bitnami/zookeeper:latest'
networks:
- kafka-net
ports:
- '2181:2181'
environment:
- ALLOW_ANONYMOUS_LOGIN=yes
kafdrop:
image: obsidiandynamics/kafdrop
networks:
- kafka-net
restart: "no"
ports:
- "9000:9000"
environment:
KAFKA_BROKERCONNECT: "PLAINTEXT://localhost:9092,PLAINTEXT://localhost:9093,PLAINTEXT://localhost:9094"
JVM_OPTS: "-Xms16M -Xmx48M -Xss180K -XX:-TieredCompilation -XX:+UseStringDeduplication -noverify"
depends_on:
- "kafka-server1"
- "kafka-server2"
- "kafka-server3"
kafka-server1:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9092:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9092
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server2:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9093:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9093
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server3:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9094:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- KAFKA_CFG_ADVERTISED_LISTENERS=PLAINTEXT://localhost:9094
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
我的主要问题是 kafdrop 总是抛出这个错误:
020-08-26 10:53:53.517 WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient : [AdminClient clientId=kafdrop-admin] Connection to node -3 (localhost/127.0.0.1:9094) could not be established. Broker may not be available.
2020-08-26 10:53:53.522 WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient : [AdminClient clientId=kafdrop-admin] Connection to node -2 (localhost/127.0.0.1:9093) could not be established. Broker may not be available.
2020-08-26 10:53:53.526 WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient : [AdminClient clientId=kafdrop-admin] Connection to node -1 (localhost/127.0.0.1:9092) could not be established. Broker may not be available.
2020-08-26 10:53:53.627 WARN 1 [| kafdrop-admin] o.a.k.c.NetworkClient : [AdminClient clientId=kafdro
我尝试KAFKA_BROKERCONNECT
用 ff 值更改 的值,但都没有奏效。
- 纯文本://本地主机:9092,纯文本://本地主机:9093,纯文本://本地主机:9094
- 本地主机:9092,本地主机:9093,本地主机:9094
- PLAINTEXT://kafka-server1:9092,PLAINTEXT://kafka-server2:9093,PLAINTEXT://kafka-server3:9094
- 卡夫卡服务器1:9092,卡夫卡服务器2:9093,卡夫卡服务器3:9094
我实际上只是在猜测正确的配置语法,所以对此的任何解释表示赞赏:)。
另外,是否networks
需要在 kafdrop 配置上添加属性?Kafdrop 有示例 docker -compose文件,而这个没有网络配置,所以我想知道为什么/如果network
需要。
解决方案
你的第二种方法是正确的方法。对于KAFKA_CFG_ADVERTISED_LISTENERS
我不确定的变量也是必要的。您只需要确保使用正确的端口即可。这应该可以正常工作:
version: '2'
networks:
kafka-net:
driver: bridge
services:
zookeeper-server:
image: 'bitnami/zookeeper:latest'
networks:
- kafka-net
ports:
- '2181:2181'
environment:
- ALLOW_ANONYMOUS_LOGIN=yes
kafdrop:
image: obsidiandynamics/kafdrop
networks:
- kafka-net
restart: "no"
ports:
- "9000:9000"
environment:
KAFKA_BROKERCONNECT: "PLAINTEXT://kafka-server1:9092,PLAINTEXT://kafka-server2:9092,PLAINTEXT://kafka-server3:9092"
JVM_OPTS: "-Xms16M -Xmx48M -Xss180K -XX:-TieredCompilation -XX:+UseStringDeduplication -noverify"
depends_on:
- "kafka-server1"
- "kafka-server2"
- "kafka-server3"
kafka-server1:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9092:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server2:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9093:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
kafka-server3:
image: 'bitnami/kafka:latest'
networks:
- kafka-net
ports:
- '9094:9092'
environment:
- KAFKA_CFG_ZOOKEEPER_CONNECT=zookeeper-server:2181
- ALLOW_PLAINTEXT_LISTENER=yes
depends_on:
- zookeeper-server
推荐阅读
- c# - 无法将 wpf 中的数据网格转换为 csv 而不会丢失阿拉伯值
- python - 在输入功能中,如何确保用户只输入精确到小数点后 2 位的数字?
- faunadb - 如何使用 FaunaDB Shell 打开我的子数据库?
- python - 如何通过在后台检测到按键来打破无限循环?
- c - 使用结构从另一个函数调用变量
- c++ - 在带有 LLD 的 Windows 10 上使用 Clang
- r - 避免覆盖 data.table 函数中的现有列
- mysql - mysql:外键不起作用?存在不应该存在的记录
- javascript - vue.js:如何从数组中的对象进行计算?
- r - 如何运行 Chow 测试以检查面板数据中随时间推移的结构性中断?