首页 > 解决方案 > AWS EMR Notebook 未进入“运行”状态

问题描述

在使用 boto3 启动 AWS EMR 集群上的笔记本时,它没有进入“运行”状态,所以我不确定我的脚本是否正常工作。注意 - 我从 lambda 函数调用 boto3 函数并使用 api 网关调用此 lambda 函数。有什么方法可以验证我的笔记本是否成功运行?

集群状态 - 等待,笔记本状态 - 已停止,笔记本已连接到集群。

` import json import boto3 导入时间

def lambda_handler(event, context): # TODO implement client = boto3.client('emr') cluster_state = client.describe_cluster(ClusterId='XXXX') print("Cluster state - \n") print(cluster_state) response = client .start_notebook_execution(EditorId='XXXX', RelativePath='XXXX', ExecutionEngine={'XXXX'}, ServiceRole='XXXX')

execution_id = response["NotebookExecutionId"]
print("========== Execution ID ==========")
print(execution_id)

describe_response = client.describe_notebook_execution(
    NotebookExecutionId=execution_id
)
print("Describing notebook execution \n")
print(describe_response)

list_response = client.list_notebook_executions()
print("Notebook execution details: \n")
for execution in list_response['NotebookExecutions']:
    print(execution)
    print("\n")

print("Sleeping for 5 sec...")
time.sleep(5)

client.stop_notebook_execution(NotebookExecutionId=execution_id)

describe_response = client.describe_notebook_execution(
    NotebookExecutionId=execution_id
)
print(describe_response)`

Cloudwatch 日志 - “状态”:“正在启动”“状态”:“已停止”“状态”:“已完成”“状态”:“已停止”“状态”:“已停止”“状态”:“已停止”“状态”:“已停止''状态':'完成''状态':'完成''状态':'失败'

标签: amazon-web-servicesaws-lambdajupyter-notebookaws-api-gatewayamazon-emr

解决方案


推荐阅读