首页 > 解决方案 > 解析参数“--configurations”时出错:在 AWS CLI 中

问题描述

我正在使用 Python 的子进程来调用此命令:

subprocess.call("aws emr create-cluster \
    --enable-debugging \
    --log-uri s3://e3-bucket/logs/ \
    --configurations https://s3.amazonaws.com/bucket/configurations/config.json \
    --steps Type=CUSTOM_JAR,Name=CustomJAR,ActionOnFailure=CONTINUE,Jar=s3://bucket/file.jar,MainClass=spark_pkg.SparkMain \
    --release-label emr-5.3.1 \
    --ec2-attributes InstanceProfile=EMR_EC2_DefaultRole \
    --service-role EMR_DefaultRole \
    --instance-groups InstanceGroupType=MASTER,InstanceCount=1,InstanceType=r4.xlarge InstanceGroupType=CORE,InstanceCount=4,InstanceType=r4.8xlarge \
    --auto-terminate", 
shell=True)

我的配置文件如下所示:

[
  {
    "Classification":"spark",
    "Properties":{
      "maximizeResourceAllocation":"true"
    }
  }
]

我收到了这个错误:

Error parsing parameter '--configurations': Unable to retrieve https://s3.amazonaws.com/bucket/configurations/config.json: received non 200 status code of 301

有谁知道我为什么会看到这个错误?

标签: pythonamazon-web-servicesshell

解决方案


推荐阅读