首页 > 解决方案 > Cloud Composer - BigQuery 作业状态检查失败

问题描述

Cloud Composer DAG 无法执行更新脚本。当我尝试阅读表格时它工作正常。BigQuery 作业状态检查失败。最终错误是:%s',404

如果我删除此标志use_legacy_sql=False并建议在标准模式下执行,它会尝试执行。

INFO - Subtask: Traceback (most recent call last):
INFO - Subtask:   File "/usr/local/bin/airflow", line 7, in <module>
INFO - Subtask:     exec(compile(f.read(), __file__, 'exec'))
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/bin/airflow", line 27, in <module>
INFO - Subtask:     args.func(args)
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/bin/cli.py", line 392, in run
INFO - Subtask:     pool=args.pool,
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/utils/db.py", line 50, in wrapper
INFO - Subtask:     result = func(*args, **kwargs)
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/models.py", line 1492, in _run_raw_task
INFO - Subtask:     result = task_copy.execute(context=context)
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/contrib/operators/bigquery_operator.py", line 98, in execute
INFO - Subtask:     self.create_disposition, self.query_params)
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/contrib/hooks/bigquery_hook.py", line 499, in run_query
INFO - Subtask:     return self.run_with_configuration(configuration)
INFO - Subtask:   File "/usr/local/lib/airflow/airflow/contrib/hooks/bigquery_hook.py", line 868, in run_with_configuration
INFO - Subtask:     err.resp.status)
INFO - Subtask: Exception: ('BigQuery job status check failed. Final error was: %s', 404)

标签: google-cloud-platformgoogle-bigqueryairflowgoogle-cloud-composer

解决方案


推荐阅读