amazon-web-services - 通过 CodeBuild 在 AWS Lambda 上安装 NLTK/WORDNET
问题描述
我正在尝试通过 CodeBuild 让 NLTK 和 Wordnet 在 lambda 上工作。
看起来它在 CloudFormation 中安装良好,但我在 Lambda 中收到以下错误:
START RequestId: c660c446-e1c4-11e8-8047-15f59f1e002c Version: $LATEST
Unable to import module 'index': No module named 'nltk'
END RequestId: c660c446-e1c4-11e8-8047-15f59f1e002c
REPORT RequestId: c660c446-e1c4-11e8-8047-15f59f1e002c Duration: 2.10 ms Billed Duration: 100 ms Memory Size: 128 MB Max Memory Used: 21 MB
但是,当我检查时,它在 CodeBuild 中安装得很好:
[Container] 2018/11/06 12:45:06 Running command pip install -U nltk
Collecting nltk
Downloading https://files.pythonhosted.org/packages/50/09/3b1755d528ad9156ee7243d52aa5cd2b809ef053a0f31b53d92853dd653a/nltk-3.3.0.zip (1.4MB)
Requirement already up-to-date: six in /usr/local/lib/python2.7/site-packages (from nltk)
Building wheels for collected packages: nltk
Running setup.py bdist_wheel for nltk: started
Running setup.py bdist_wheel for nltk: finished with status 'done'
Stored in directory: /root/.cache/pip/wheels/d1/ab/40/3bceea46922767e42986aef7606a600538ca80de6062dc266c
Successfully built nltk
Installing collected packages: nltk
Successfully installed nltk-3.3
这是实际的python代码:
import json
import datetime
import nltk
from nltk.corpus import wordnet as wn
这是 YML 文件:
version: 0.2
phases:
install:
commands:
# Upgrade AWS CLI to the latest version
- pip install --upgrade awscli
# Install nltk & WordNet
- pip install -U nltk
- python -m nltk.downloader wordnet
pre_build:
commands:
# Discover and run unit tests in the 'tests' directory. For more information, see <https://docs.python.org/3/library/unittest.html#test-discovery>
# - python -m unittest discover tests
build:
commands:
# Use AWS SAM to package the application by using AWS CloudFormation
- aws cloudformation package --template template.yml --s3-bucket $S3_BUCKET --output-template template-export.yml
artifacts:
type: zip
files:
- template-export.yml
知道为什么它在 CodeBuild 中安装良好但无法访问 Lambda 中的模块 NLTK 吗?作为参考,如果您仅删除 NLTK,则代码在 lambda 中运行良好。
我感觉这是一个 YML 文件问题,但不确定是什么,因为 NLTK 安装良好。
解决方案
NLTK 仅安装在本地,即运行 CodeBuild 作业的机器上。您需要将 NLTK 复制到 CloudFormation 部署包中。您的buildspec.yml
遗嘱将如下所示:
install:
commands:
# Upgrade AWS CLI to the latest version
- pip install --upgrade awscli
pre_build:
commands:
- virtualenv /venv
# Install nltk & WordNet
- pip install -U nltk
- python -m nltk.downloader wordnet
build:
commands:
- cp -r /venv/lib/python3.6/site-packages/. ./
# Use AWS SAM to package the application by using AWS CloudFormation
- aws cloudformation package --template template.yml --s3-bucket $S3_BUCKET --output-template template-export.yml
补充阅读:
推荐阅读
- scala - 在包 Intellij IDEA 中找不到套件类
- java - for循环初始化语句Java中的变量范围
- javascript - 如何使用 selenium webdriver 处理角度覆盖并从下拉列表中选择多个值(来自 excel)
- sql - 我在 PostgreSQL 中遇到语法错误问题。我正在尝试添加一个查询,但它给了我一个错误
- react-native - react-native-image-slider-box 未按预期工作
- javascript - React - 组件未更新
- python - 如何将HSV色彩空间的V通道的值设置为恒定值
- ffmpeg - FFMPEG 将不正确的 mp4 转换为 ts
- javascript - 为什么 console.table 仅在深度级别 2 打印(使用 toString)有限的元素
- javascript - 如何延迟获取请求直到异步函数完成加载