airflow - 如何抑制气流 cli 输出中的错误?
问题描述
研究一些气流监控的想法。当我执行时,airflow list_tasks my_dag
我会得到很多不需要的垃圾以及实际所需的输出:
[2018-12-11 22:39:00,301] {__init__.py:51} INFO - Using executor SequentialExecutor
[2018-12-11 22:39:00,423] {models.py:271} INFO - Filling up the DagBag from /root/airflow/dags
[2018-12-11 22:39:00,448] {models.py:380} ERROR - Failed to import: /usr/local/lib/python3.7/site-packages/airflow/example_dags/example_http_operator.py
Traceback (most recent call last):
File "/usr/local/lib/python3.7/site-packages/airflow/models.py", line 377, in process_file
m = imp.load_source(mod_name, filepath)
File "/usr/local/lib/python3.7/imp.py", line 171, in load_source
module = _load(spec)
File "<frozen importlib._bootstrap>", line 696, in _load
File "<frozen importlib._bootstrap>", line 677, in _load_unlocked
File "<frozen importlib._bootstrap_external>", line 728, in exec_module
File "<frozen importlib._bootstrap>", line 219, in _call_with_frames_removed
File "/usr/local/lib/python3.7/site-packages/airflow/example_dags/example_http_operator.py", line 27, in <module>
from airflow.operators.http_operator import SimpleHttpOperator
File "/usr/local/lib/python3.7/site-packages/airflow/operators/http_operator.py", line 21, in <module>
from airflow.hooks.http_hook import HttpHook
File "/usr/local/lib/python3.7/site-packages/airflow/hooks/http_hook.py", line 23, in <module>
import tenacity
File "/usr/local/lib/python3.7/site-packages/tenacity/__init__.py", line 352
from tenacity.async import AsyncRetrying
^
SyntaxError: invalid syntax
also_run_this
run_after_loop
run_this_last
runme_0
runme_1
runme_2
我真正需要的是:
还有_run_this
run_after_loop
run_this_last
runme_0
runme_1
runme_2
除了实际结果之外,有没有办法压制所有?
解决方案
将坚韧升级到最新版本。虽然在升级过程中它会显示一个警告:“apache-airflow 1.10.1 有要求 tenacity==4.8.0,但你将有不兼容的韧度 5.0.2”。请忽略这个
兼容性:Python 3.7.1 apache-airflow 1.10.1 韧性 5.0.2
希望这可以帮助!
推荐阅读
- javascript - Puppeteer - 在框架内运行函数
- angularjs - 添加到重复列表后编辑嵌套选择选项
- hyperlink - shinydashboard:如何将 menusubitem 放在超链接之外
- sql-server - 如何将组合信息从一个表显示到另一个表?
- javascript - 让一个 div 在悬停时替换另一个
- machine-learning - 将我的图像数据集划分为 Mask_RCNN 的训练/验证的最佳配给是多少?
- c# - C# 命名空间、导入的类和编辑
- jhipster - Jhipster JhiLanguageService 总是指向相对路径
- c# - 登录后在 OnTicketReceived 事件中检索 cookie
- applescript - 找不到此 Carbon/Apple 事件错误的定义