时间戳

首页 > 解决方案 > Python requests.get with stream=true 冻结

python - Python requests.get with stream=true 冻结

问题描述

我有这样的功能：

def saveImg(url, dir, fileName):
    with open(fileName, 'wb') as handle:
        try:
            response = requests.get(url, stream=True)
            if not response.ok:
                return 1
            for chunk in response:
                handle.write(chunk)
        except Exception as e: 
            print(e)
            return 1
    return 0

但是我发现它偶尔会挂起并按Ctrl+c没有用（我正在使用windows powershell运行脚本，ctrl+c应该立即中断脚本），杀死脚本运行需要很长时间，并且堆栈跟踪如下：

Traceback (most recent call last):
  File ".\self_null\test.py", line 235, in <module>
    runTask()
  File ".\self_null\test.py", line 64, in runTask
    oneTask(currentLink, dir, fileName)
  File ".\self_null\test.py", line 110, in oneTask
    saveRes = saveImg(imgLink, dir, fileName)
  File ".\self_null\test.py", line 196, in saveImg
    response = requests.get(url, stream=True)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\requests\api.py", line 76, in get
    return request('get', url, params=params, **kwargs)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\requests\api.py", line 61, in request
    return session.request(method=method, url=url, **kwargs)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\requests\sessions.py", line 542, in request
    resp = self.send(prep, **send_kwargs)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\requests\sessions.py", line 655, in send
    r = adapter.send(request, **kwargs)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\requests\adapters.py", line 449, in send
    timeout=timeout
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\connectionpool.py", line 706, in urlopen
    chunked=chunked,
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\connectionpool.py", line 382, in _make_request
    self._validate_conn(conn)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\connectionpool.py", line 1010, in _validate_conn
    conn.connect()
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\connection.py", line 421, in connect
    tls_in_tls=tls_in_tls,
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\util\ssl_.py", line 429, in ssl_wrap_socket
    sock, context, tls_in_tls, server_hostname=server_hostname
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\site-packages\urllib3\util\ssl_.py", line 472, in _ssl_wrap_socket_impl
    return ssl_context.wrap_socket(sock, server_hostname=server_hostname)
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\ssl.py", line 423, in wrap_socket
    session=session
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\ssl.py", line 870, in _create
    self.do_handshake()
  File "C:\Program Files (x86)\Microsoft Visual Studio\Shared\Python37_64\lib\ssl.py", line 1139, in do_handshake
    self._sslobj.do_handshake()
KeyboardInterrupt

我的环境是 Python 3.7 64bit 并且请求库版本是 2.25.1

任何想法为什么该请求挂起？

标签： pythonpython-3.xpython-requests

解决方案

推荐阅读