首页 > 解决方案 > 在python中请求超时

问题描述

我正在尝试向 Louis Vuitton 发送请求,但我使用的所有库都无法得到响应。即使我可以从浏览器访问该网站。我做错了什么吗?

我使用过requestsurllib3BeautifulSoup,但我对这些库的试验都没有成功。

代码:

from urllib.request import Request, urlopen
from bs4 import BeautifulSoup as soup


url = 'https://us.louisvuitton.com/eng-us/products/pocket-organizer-monogram-other-nvprod2380073v'
req = Request(url , headers={'User-Agent': 'Chrome/84.0.4147.105'})

webpage = urlopen(req).read()
page_soup = soup(webpage, "html.parser")
title = page_soup.find("title")
print(title)

输出:不给我,只是保持空白,直到我键盘中断。

注意:本项目的目的是监控网站以检测是否发生任何变化。(钱包有货了)

标签: pythonbeautifulsouppython-requestsurllib3

解决方案


你是headers不正确的。

from urllib.request import Request, urlopen
from bs4 import BeautifulSoup as soup

HEADERS = {
'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko)'
}

url = 'https://us.louisvuitton.com/eng-us/products/pocket-organizer-monogram-other-nvprod2380073v'
req = Request(url, headers=HEADERS)

webpage = urlopen(req).read()
page_soup = soup(webpage, "html.parser")
title = page_soup.find("title")
print(title.text)

输出:

Pocket Organizer Monogram Other in Blue - Small Leather Goods M69679 | LOUIS VUITTON ®

推荐阅读