时间戳

首页 > 解决方案 > 带有 ssl 的 Spring kafka，生产者错误“重复键”

java - 带有 ssl 的 Spring kafka，生产者错误“重复键”

问题描述

我有一个带 SSL 的 Kafka 服务器。向其生成消息时，会发生错误：

2020-05-29 19:19:27.677 [kafka-producer-network-thread | producer-1] ERROR o.a.k.c.producer.internals.Sender - [Producer clientId=producer-1] Uncaught error in kafka producer I/O thread: 
java.lang.IllegalStateException: Duplicate key host:9091 (id: 1 rack: null)
    at java.util.stream.Collectors.lambda$throwingMerger$0(Collectors.java:133)
    at java.util.HashMap.merge(HashMap.java:1254)
    at java.util.stream.Collectors.lambda$toMap$58(Collectors.java:1320)

我对它暗示的“重复键”感到困惑。我的配置application.properties：

spring.kafka.bootstrap-servers=host:9091
spring.kafka.properties.security.protocol=SSL
spring.kafka.ssl.trust-store-password=kafka
spring.kafka.properties.ssl.endpoint.identification.algorithm=
spring.kafka.ssl.key-store-password=abc
spring.kafka.ssl.trust-store-location=file:/path/client.truststore.jks
spring.kafka.ssl.key-store-location=file:/path/client.keystore.jks

Kafka生产者在运行时从日志中的部分配置：

    acks = 1
    bootstrap.servers = [host:9091]
    client.dns.lookup = default
    client.id = 
    enable.idempotence = false
    interceptor.classes = []
    key.serializer = class org.apache.kafka.common.serialization.StringSerializer
    linger.ms = 0
    partitioner.class = class org.apache.kafka.clients.producer.internals.DefaultPartitioner
    security.protocol = SSL
    ssl.cipher.suites = null
    ssl.enabled.protocols = [TLSv1.2, TLSv1.1, TLSv1]
    ssl.endpoint.identification.algorithm = 
    ssl.key.password = null
    ssl.keymanager.algorithm = SunX509
    ssl.keystore.location = /path/client.keystore.jks
    ssl.keystore.password = [hidden]
    ssl.keystore.type = JKS
    ssl.protocol = TLS
    ssl.provider = null
    ssl.secure.random.implementation = null
    ssl.trustmanager.algorithm = PKIX
    ssl.truststore.location = /path/client.truststore.jks
    ssl.truststore.password = [hidden]
    ssl.truststore.type = JKS
    transactional.id = null
    value.serializer = class org.apache.kafka.common.serialization.StringSerializer

有什么问题吗？任何帮助将不胜感激。

根据本文档中的表格，我想到版本可能不兼容。我的版本：

spring-boot: 2.2.6.RELEASE
spring-kafka: 2.3.7.RELEASE
Kafka server: 0.10.1.1

但是，通过使用当前版本，我能够在没有 SSL 的情况下从 Kafka 服务器（0.10.0.0）成功地生产和消费。

标签： javaapache-kafkaspring-kafka

解决方案

推荐阅读