时间戳

首页 > 解决方案 > 带有 s3 logdir 的 Tensorboard/tensorflow - curl 返回错误代码 6

tensorflow - 带有 s3 logdir 的 Tensorboard/tensorflow - curl 返回错误代码 6

问题描述

一直在尝试许多设置/env-vars/tf-versions 但不起作用..

在我的本地机器上这有效：AWS_ACCESS_KEY_ID=XXX AWS_SECRET_ACCESS_KEY=XXX AWS_REGION=eu-west-1 tensorboard --logdir="s3://my-bucket/tflogs/"

在 AWS 实例上，这将抛出：

I tensorflow/core/platform/s3/aws_logging.cc:54] Creating HttpClient with max connections2 and scheme http
I tensorflow/core/platform/s3/aws_logging.cc:54] Initializing CurlHandleContainer with size 2
I tensorflow/core/platform/s3/aws_logging.cc:54] Creating Instance with default EC2MetadataClient and refresh rate 900000
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
I tensorflow/core/platform/s3/aws_logging.cc:54] Initializing CurlHandleContainer with size 25
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
I tensorflow/core/platform/s3/aws_logging.cc:54] Pool grown by 2
I tensorflow/core/platform/s3/aws_logging.cc:54] Connection has been released. Continuing.
E tensorflow/core/platform/s3/aws_logging.cc:60] Curl returned error code 6
W tensorflow/core/platform/s3/aws_logging.cc:57] If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.
W tensorflow/core/platform/s3/aws_logging.cc:57] Request failed, now waiting 0 ms before attempting again.
I tensorflow/core/platform/s3/aws_logging.cc:54] Found secret key
2018-08-14 16:32:18.725199: I tensorflow/core/platform/s3/aws_logging.cc:54] Connection has been released. Continuing.
E tensorflow/core/platform/s3/aws_logging.cc:60] Curl returned error code 6
W tensorflow/core/platform/s3/aws_logging.cc:57] If the signature check failed. This could be because of a time skew. Attempting to adjust the signer.


在https://github.com/tensorflow/tensorflow/issues/16397 中没有找到任何提示

并且没有明确的线索可能存在差异，我确保拥有相同的 tensorflow/tensorboard 版本（1.8.0）。也会发生在指定 s3 tensorboard logdir 的情况下运行 tensorflow。

标签： tensorflowamazon-s3tensorboard

解决方案

Solved it like this:

export AWS_ACCESS_KEY_ID=<access key id>
export AWS_SECRET_ACCESS_KEY=<secret access key>
export AWS_REGION=us-west-2
export S3_REGION=us-west-2
export S3_ENDPOINT=s3.us-west-2.amazonaws.com
export S3_USE_HTTPS=1
export S3_VERIFY_SSL=0

tensorboard --logdir=s3://<path>

推荐阅读