python-3.x - urllib.error.HTTPError：HTTP 错误 429：Python googlesearch 包的 search() 中的请求过多

Question

实际上，我正在 python 的 GoogleSearch 包的 search() 中运行一个查询，它以列表格式提供来自 google 搜索的多个链接

search(query, tld='com', lang='en', num=20, start=0, stop=None, pause=2.0):

我也能得到结果，但过了一段时间它给出了一个错误，比如

for i in search(query, tld='com', lang='en', num=20, start=0, stop=None, pause=2.0):
  File "E:\crawling\venv\lib\site-packages\googlesearch\__init__.py", line 312, in search
    html = get_page(url, user_agent)
  File "E:\crawling\venv\lib\site-packages\googlesearch\__init__.py", line 176, in get_page
    response = urlopen(request)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 222, in urlopen
    return opener.open(url, data, timeout)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 563, in error
    result = self._call_chain(*args)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 755, in http_error_302
    return self.parent.open(new, timeout=req.timeout)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 531, in open
    response = meth(req, response)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 641, in http_response
    'http', request, response, code, msg, hdrs)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 569, in error
    return self._call_chain(*args)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 503, in _call_chain
    result = func(*args)
  File "C:\Users\shubh\Anaconda3\lib\urllib\request.py", line 649, in http_error_default
    raise HTTPError(req.full_url, code, msg, hdrs, fp)
urllib.error.HTTPError: HTTP Error 429: Too Many Requests

我还增加了搜索参数中的暂停时间，但对我没有帮助。

标签： python-3.xselenium-chromedrivergoogle-search