时间戳

首页 > 解决方案 > 更换发电机内的返回

python - 更换发电机内的返回

问题描述

我正在尝试部署一个 Scrapy 蜘蛛来抓取，但是，我在 Python3 中编写了shub不允许的代码，所以我需要将代码转换为 Python2.7

Deploy log last 30 lines:
    _get_apisettings, commands_module='sh_scrapy.commands')
  File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 148, in _run_usercode
    _run(args, settings)
  File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 103, in _run
    _run_scrapy(args, settings)
  File "/usr/local/lib/python2.7/site-packages/sh_scrapy/crawl.py", line 111, in _run_scrapy
    execute(settings=settings)
  File "/usr/local/lib/python2.7/site-packages/scrapy/cmdline.py", line 149, in execute
    cmd.crawler_process = CrawlerProcess(settings)
  File "/usr/local/lib/python2.7/site-packages/scrapy/crawler.py", line 251, in __init__
    super(CrawlerProcess, self).__init__(settings)
  File "/usr/local/lib/python2.7/site-packages/scrapy/crawler.py", line 137, in __init__
    self.spider_loader = _get_spider_loader(settings)
  File "/usr/local/lib/python2.7/site-packages/scrapy/crawler.py", line 338, in _get_spider_loader
    return loader_cls.from_settings(settings.frozencopy())
  File "/usr/local/lib/python2.7/site-packages/scrapy/spiderloader.py", line 61, in from_settings
    return cls(settings)
  File "/usr/local/lib/python2.7/site-packages/scrapy/spiderloader.py", line 25, in __init__
    self._load_all_spiders()
  File "/usr/local/lib/python2.7/site-packages/scrapy/spiderloader.py", line 47, in _load_all_spiders
    for module in walk_modules(name):
  File "/usr/local/lib/python2.7/site-packages/scrapy/utils/misc.py", line 71, in walk_modules
    submod = import_module(fullpath)
  File "/usr/local/lib/python2.7/importlib/__init__.py", line 37, in import_module
    __import__(name)
  File "/app/__main__.egg/niceprice/spiders/example.py", line 114
SyntaxError: 'return' with argument inside generator
{"message": "shub-image-info exit code: 1", "details": null, "error": "image_info_error"}

这是因为蜘蛛中的这条线

    def prase_item(self,response):
        if search('&WS=\d*',response.request.url):
            return 0

有没有一种等效的方法来实现这一点，我尝试让步，None但它破坏了我的管道。我使用return是因为我不希望产生任何东西（停止此迭代继续）

标签： pythongenerator

解决方案

推荐阅读