python - Beautiful Soup 没有提供任何东西，尽管存在价值

Question

为什么我的以下代码给出了输出NONE

from bs4 import BeautifulSoup
import urllib3
import warnings
warnings.filterwarnings("ignore", category=FutureWarning)
urllib3.disable_warnings()
url = "https://www.amazon.ae/dp/B07N62ZGWQ/ref=br_msw_pdt-5?_encoding=UTF8&smid=ABO0A2K2SKD5O&pf_rd_m=A2KKU8J8O8784X&pf_rd_s=&pf_rd_r=GZ376KPZWEXC0TBHXPKY&pf_rd_t=36701&pf_rd_p=da8f558b-6ee9-4705-8e31-6a4c345b29e8&pf_rd_i=desktop"
http = urllib3.PoolManager()
r = http.request('GET', url)
content = r.data.decode('utf-8')
soup = BeautifulSoup(content,'html.parser')
print(soup.find('span', {'id':"priceblock_ourprice"}))

我尝试使用soup.find(id="priceblock_ourprice"), soup.select("#priceblock_ourprice")，但都给出了 None 输出。

ID 出现在页面上并且也有一个值。

标签： pythonbeautifulsoup

Answer 1

首先，我改成urllib3因为requests给出urllib3了一个例外

请看下面的代码：

import requests
from bs4 import BeautifulSoup

url = "https://www.amazon.ae/dp/B07N62ZGWQ/ref=br_msw_pdt-5?_encoding=UTF8&smid=ABO0A2K2SKD5O&pf_rd_m=A2KKU8J8O8784X&pf_rd_s=&pf_rd_r=GZ376KPZWEXC0TBHXPKY&pf_rd_t=36701&pf_rd_p=da8f558b-6ee9-4705-8e31-6a4c345b29e8&pf_rd_i=desktop"

response = requests.request('GET', url)
content = response.content.decode('utf-8')
soup = BeautifulSoup(content, 'html.parser')
table = soup.find('table', attrs={'class': 'a-lineitem'})
price_blocks = table.find_all('span', attrs={'id': 'priceblock_ourprice'})
prices = [block.text for block in price_blocks]
print(prices)

输出控制台：

['AED26.00']