首页 > 解决方案 > 如何在网站上实现用户输入以转到特定网站进行抓取

问题描述

我一直在使用网络爬虫来获取特定邮政编码的天气。但是,我不知道如何使用网站上的用户输入来接收他们特定邮政编码的天气

我没有尝试太多,因为我对输入用户输入不是很熟悉

import requests
from bs4 import BeautifulSoup
import pandas as pd


r = requests.get(
    "https://forecast.weather.gov/MapClick.php?lat=33.870330000000024&lon=-117.92895999999996"
)
soup = BeautifulSoup(r.content, "html.parser")
week = soup.find(id="seven-day-forecast-body")

items = week.find_all(class_="tombstone-container")

period_names = [item.find(class_="period-name").get_text() for item in items]
short_descriptions = [item.find(class_="short-desc").get_text() for item in items]
temps = [item.find(class_="temp").get_text() for item in items]


weather = pd.DataFrame(
    {"Period": period_names, "Description": short_descriptions, "Temperature": temps}
)

print(weather)
weather.to_csv("weather.csv")

标签: pythonpython-3.xpython-requests

解决方案


推荐阅读