时间戳

首页 > 解决方案 > AttributeError：“S3File”对象在运行 to_csv 时没有属性“getvalue”

amazon-s3 - AttributeError：“S3File”对象在运行 to_csv 时没有属性“getvalue”

问题描述

我正在对启用的存储桶to_csv上的输出文件运行如下命令：s3ServerSideEncryption

to_csv("s3://mys3bucket/result.csv",
       storage_option={'s3_additional_kwargs':
           {'ServerSideEncryption': 'AES256'}})

我收到以下属性错误：

 File "/usr/lib/python2.7/site-packages/dask/dataframe/core.py", line 1091, in to_csv
    return to_csv(self, filename, **kwargs)
  File "/usr/lib/python2.7/site-packages/dask/dataframe/io/csv.py", line 577, in to_csv
    delayed(values).compute(get=get, scheduler=scheduler)
  File "/usr/lib/python2.7/site-packages/dask/base.py", line 156, in compute
    (result,) = compute(self, traverse=False, **kwargs)
  File "/usr/lib/python2.7/site-packages/dask/base.py", line 400, in compute
    results = schedule(dsk, keys, **kwargs)
  File "/usr/lib/python2.7/site-packages/distributed/client.py", line 2159, in get
    direct=direct)
  File "/usr/lib/python2.7/site-packages/distributed/client.py", line 1562, in gather
    asynchronous=asynchronous)
  File "/usr/lib/python2.7/site-packages/distributed/client.py", line 652, in sync
    return sync(self.loop, func, *args, **kwargs)
  File "/usr/lib/python2.7/site-packages/distributed/utils.py", line 275, in sync
    six.reraise(*error[0])
  File "/usr/lib/python2.7/site-packages/distributed/utils.py", line 260, in f
    result[0] = yield make_coro()
  File "/usr/lib64/python2.7/site-packages/tornado/gen.py", line 1099, in run
    value = future.result()
  File "/usr/lib64/python2.7/site-packages/tornado/concurrent.py", line 260, in result
    raise_exc_info(self._exc_info)
  File "/usr/lib64/python2.7/site-packages/tornado/gen.py", line 1107, in run
    yielded = self.gen.throw(*exc_info)
  File "/usr/lib/python2.7/site-packages/distributed/client.py", line 1439, in _gather
    traceback)
  File "/usr/lib/python2.7/site-packages/dask/dataframe/io/csv.py", line 439, in _to_csv_chunk
    df.to_csv(f, **kwargs)
  File "/usr/lib64/python2.7/site-packages/pandas/core/frame.py", line 1745, in to_csv
    formatter.save()
  File "/usr/lib64/python2.7/site-packages/pandas/io/formats/csvs.py", line 161, in save
    buf = f.getvalue()
  File "/usr/lib/python2.7/site-packages/dask/bytes/utils.py", line 136, in __getattr__
    return getattr(self.file, key)
AttributeError: 'S3File' object has no attribute 'getvalue'

我搜索了这个错误，但找不到相关的解决方案。你有什么主意吗？

标签： amazon-s3daskdask-distributed

解决方案

推荐阅读