时间戳

首页 > 解决方案 > Kafka Snowflake ConnectStandalone - 启动 Snowflake 连接器时出错

apache-kafka - Kafka Snowflake ConnectStandalone - 启动 Snowflake 连接器时出错

问题描述

在此处输入图像描述

[SF_KAFKA_CONNECTOR] SnowflakeSinkTask[ID:0]:start. Time: 0 seconds (com.snowflake.kafka.connector.SnowflakeSinkTask:154)
[2021-09-07 23:19:44,145] INFO WorkerSinkTask{id=snowflakeslink-0} Sink task finished initialization and start (org.apache.kafka.connect.runtime.WorkerSinkTask:309)
[2021-09-07 23:19:44,169] WARN [Consumer clientId=connector-consumer-snowflakeslink-0, groupId=connect-snowflakeslink] Connection to node -1 (localhost/127.0.0.1:9092) terminated during authentication. This may happen due to any of the following reasons: (1) Authentication failed due to invalid credentials with brokers older than 1.0.0, (2) Firewall blocking Kafka TLS traffic (eg it may only allow HTTPS traffic), (3) Transient network issue. (org.apache.kafka.clients.NetworkClient:769)
[2021-09-07 23:19:44,170] WARN [Consumer clientId=connector-consumer-snowflakeslink-0, groupId=connect-snowflakeslink] Bootstrap broker localhost:9092 (id: -1 rack: null) disconnected (org.apache.kafka.clients.NetworkClient:1060)

标签： apache-kafkakafka-consumer-apiapache-kafka-connect

解决方案

连接...在身份验证期间终止

您需要consumer.security.protocol=SSL在您的 connect-standalone.properties 中删除，因为您的代理server.properties listener没有使用 SSL

你的下一个错误

找不到任何实现 Connector 且名称与 com.snowflake.kafka.connector.SnowflakeSinkConnector 匹配的类，可用的连接器有：PluginDesc{klass=class org.apache.kafka.connect.file.FileStreamSinkConnector, name='org.apache。 kafka.connect.file.FileStreamSinkConnector

看列表，确实不存在，说明你没有正确解压Snowflake连接器库到plugin.path里面，应该是Kafka内部文件夹外部的lib文件夹，比如plugin.path=/opt/kafka-connectors/有一个子文件夹，snowflake里面包含了所有的需要的 JAR。这样，它不会与依赖此文件夹的代理和其他 Kafka/Zookeeper CLI 工具的实际类路径冲突

推荐阅读