首页 > 解决方案 > Selenium 从晨星返回空列表

问题描述

我正在尝试从晨星中提取信息,但驱动程序返回一个空列表。

这是代码:

from selenium import webdriver
import time
import datetime
from selenium.webdriver.common.keys import Keys

driver = webdriver.Chrome(<<...>>)
driver.implicitly_wait(1)
driver.maximize_window()

driver.get('https://www.morningstar.it/it/etf/snapshot/snapshot.aspx?id=0P0001J2VK&tab=3&InvestmentType=FE')
time.sleep(5)
driver.find_element_by_id("individualinvestor").click()
time.sleep(1)
driver.find_element_by_id("_evidon-accept-button").click()
time.sleep(1)

usStock=driver.find_elements_by_xpath('//*[@class="sal-asset-allocation__assetTableRow sal-asset-allocation__assetTableRow--usStock"]/td[2]')

谢谢

标签: seleniumselenium-webdriver

解决方案


那是因为它在iframe中,所以你需要先像这样切换它:

wait = WebDriverWait(driver, 20)
wait.until(EC.frame_to_be_available_and_switch_to_it((By.ID, "portfolio")))
usStock = driver.find_elements_by_xpath('//*[@class="sal-asset-allocation__assetTableRow sal-asset-allocation__assetTableRow--usStock"]/td[2]')

进口:

from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.common.by import By
from selenium.webdriver.support import expected_conditions as EC

另外,我会像这样刮它(因为 time.sleep() 根本不推荐)所以你可以像这样使用 Explicit wait :

driver = webdriver.Chrome(driver_path)
driver.maximize_window()
driver.implicitly_wait(30)
driver.get("https://www.morningstar.it/it/etf/snapshot/snapshot.aspx?id=0P0001J2VK&tab=3&InvestmentType=FE")
wait = WebDriverWait(driver, 20)
wait.until(EC.element_to_be_clickable((By.ID, "individualinvestor"))).click()
wait.until(EC.element_to_be_clickable((By.ID, "_evidon-accept-button"))).click()
wait.until(EC.frame_to_be_available_and_switch_to_it((By.ID, "portfolio")))
usStock = driver.find_elements_by_css_selector("tr[class*='al-asset-allocation'] td")
print(len(usStock))
for stock in usStock:
    print(stock.text)

推荐阅读