时间戳

首页 > 解决方案 > pyspark.sql.utils.StreamingQueryException：找不到所需的属性“值”

python - pyspark.sql.utils.StreamingQueryException：找不到所需的属性“值”

问题描述

我正在尝试实现从一个 kafka 主题读取数据的 spark 流，并且我正在尝试写入另一个 kafka 主题消费者，但我收到了这个错误：

Traceback (most recent call last):
  File "/opt/spark/stream.py", line 52, in <module>
    flower_agg_write_stream.awaitTermination()
  File "/opt/spark/python/lib/pyspark.zip/pyspark/sql/streaming.py", line 101, in awaitTermination
  File "/opt/spark/python/lib/py4j-0.10.9-src.zip/py4j/java_gateway.py", line 1305, in __call__
  File "/opt/spark/python/lib/pyspark.zip/pyspark/sql/utils.py", line 117, in deco
pyspark.sql.utils.StreamingQueryException: Required attribute 'value' not found
=== Streaming Query ===

每当我运行我的应用程序时

spark-submit 的命令：

spark-submit --packages org.apache.spark:spark-sql-kafka-0-10_2.12:3.1.2  --master spark://spark.us-west1-b.c.spark-streaming-326814.internal:7077 --deploy-mode client stream.py

标签： pythonapache-sparkpysparkapache-kafka

解决方案

推荐阅读