首页 > 解决方案 > GCP 数据流配额问题

问题描述

我是 GCP 平台的新手。我正在设置一个数据流作业,该作业从 pub/sub 主题收集数据并将其发送到 bigquery,但我遇到了配额问题。请参阅下面的错误代码。我期待着得到推荐。请帮忙。

    {
  "textPayload": "Project gold-apparatus-312313 has insufficient quota(s) to execute this workflow with 1 instances in region us-central1. Quota summary (required/available): 1/7 instances, 4/4 CPUs, 1230/818 disk GB, 0/250 SSD disk GB, 1/99 instance groups, 1/49 managed instance groups, 1/99 instance templates, 1/3 in-use IP addresses.\n\nPlease see https://cloud.google.com/compute/docs/resource-quotas about requesting more quota.",
  "insertId": "fjxvatcdw1",
  "resource": {
    "type": "dataflow_step",
    "labels": {
      "project_id": "76303513563",
      "region": "us-central1",
      "step_id": "",
      "job_id": "2021-05-07_16_07_09-4793338291722263008",
      "job_name": "my_job1"
    }
  },
  "timestamp": "2021-05-07T23:16:20.877954859Z",
  "severity": "WARNING",
  "labels": {
    "dataflow.googleapis.com/region": "us-central1",
    "dataflow.googleapis.com/log_type": "system",
    "dataflow.googleapis.com/job_id": "2021-05-07_16_07_09-4793338291722263008",
    "dataflow.googleapis.com/job_name": "my_job1"
  },
  "logName": "projects/gold-apparatus-312313/logs/dataflow.googleapis.com%2Fjob-message",
  "receiveTimestamp": "2021-05-07T23:16:21.809934742Z"
}

标签: google-cloud-platformcloudgoogle-cloud-pubsubdataflow

解决方案


您的错误代码显示磁盘大小配额不足(必需 - 1230 Available-818)。因此建议增加您的配额。

如需增加配额,您可以申请增加配额。

提交 GCE 配额增加: https: //support.google.com/cloud/answer/6075746

参考:

Dataflow 的配额和限制 - https://cloud.google.com/dataflow/quotas


推荐阅读