python - 由于找不到满足 setuptools>=40.8 要求的版本，apache beam 2.19.0 不再在云数据流上运行

Question

几天后，我们的 python 数据流作业导致 worker 启动时出错：

"ERROR: Could not find a version that satisfies the requirement setuptools>=40.8.0 
(from versions: none)"

ERROR: Command errored out with exit status 1: /usr/local/bin/python3 
/usr/local/lib/python3.5/site-packages/pip install --ignore-installed --no-user --prefix 
/tmp/pip-build-env-qz0ogm1p/overlay --no-warn-script-location --no-binary :none: --only-binary
 :none: --no-index --find-links /var/opt/google/dataflow -- 'setuptools>=40.8.0' wheel Check the 
logs for full command output.

这似乎不是 requirements.txt 的问题，它们是：

ua-parser
numpy
pandas
Deprecated

有没有人遇到过这个，也许是一个解决方案？我确实尝试设置特定的 setuptools 版本（46.1.3），这导致了另一个错误：

ERROR: Could not find a version that satisfies the requirement wheel (from versions: none)

"ERROR: Command errored out with exit status 1: /usr/local/bin/python3 
/usr/local/lib/python3.5/site-packages/pip install --ignore-installed --no-user --prefix 
/tmp/pip-build-env-2awl4fw3/overlay --no-warn-script-location --no-binary :none: --only-binary 
:none: --no-index --find-links /var/opt/google/dataflow -- 'setuptools>=40.8.0' wheel Check the
 logs for full command output." 

谢谢

标签： pythongoogle-cloud-dataflowapache-beam

Answer 1

我和你有同样的问题。为了解决这个问题，我在 requirements.txt 中添加了 setuptools 并确保它在 apache-beam 之前排序。