google-cloud-platform - Cloud Composer - BigQuery 作业状态检查失败
问题描述
Cloud Composer DAG 无法执行更新脚本。当我尝试阅读表格时它工作正常。BigQuery 作业状态检查失败。最终错误是:%s',404
如果我删除此标志use_legacy_sql=False并建议在标准模式下执行,它会尝试执行。
INFO - Subtask: Traceback (most recent call last):
INFO - Subtask: File "/usr/local/bin/airflow", line 7, in <module>
INFO - Subtask: exec(compile(f.read(), __file__, 'exec'))
INFO - Subtask: File "/usr/local/lib/airflow/airflow/bin/airflow", line 27, in <module>
INFO - Subtask: args.func(args)
INFO - Subtask: File "/usr/local/lib/airflow/airflow/bin/cli.py", line 392, in run
INFO - Subtask: pool=args.pool,
INFO - Subtask: File "/usr/local/lib/airflow/airflow/utils/db.py", line 50, in wrapper
INFO - Subtask: result = func(*args, **kwargs)
INFO - Subtask: File "/usr/local/lib/airflow/airflow/models.py", line 1492, in _run_raw_task
INFO - Subtask: result = task_copy.execute(context=context)
INFO - Subtask: File "/usr/local/lib/airflow/airflow/contrib/operators/bigquery_operator.py", line 98, in execute
INFO - Subtask: self.create_disposition, self.query_params)
INFO - Subtask: File "/usr/local/lib/airflow/airflow/contrib/hooks/bigquery_hook.py", line 499, in run_query
INFO - Subtask: return self.run_with_configuration(configuration)
INFO - Subtask: File "/usr/local/lib/airflow/airflow/contrib/hooks/bigquery_hook.py", line 868, in run_with_configuration
INFO - Subtask: err.resp.status)
INFO - Subtask: Exception: ('BigQuery job status check failed. Final error was: %s', 404)
解决方案
推荐阅读
- kiwi-tcms - 重置所有表数据但并恢复初始设置
- spring - Apache CXF JaxWsProxyFactoryBean SSL 配置调用外部 https 失败
- windows - WSUS Package Publisher 从属性中“杀死”引用
- r - 从带有条件的表中提取数据
- javascript - 内容安全策略阻止 script-src - React 应用程序
- snakemake - 输入文件中的 Snakemake-通配符无法从输出文件中确定
- mongodb - FilterDefinitionBuidler 忽略与字段的给定值匹配的文档
- python - 可以在 SageMaker(实验室 1.2.*)上使用 dask 仪表板吗?
- django - 在 Caddy 反向代理后面使用 Django 时的 ALLOWED_HOSTS
- java - 二分搜索算法不返回变量