python - 如何在涉及类名称空间的 selenium python 中刮取 li 标签？

Question

<div class="all__BrandsAllListGrid-sc-1410m2d-5 eWrRoU"><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/00-seeds">00 Seeds</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1-luv-farms">1 Luv Farms</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1-lyfe">1 Lyfe</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1-puff">1 PUFF</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/101-cannabis">101 Cannabis</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/101-cbd">101 CBD</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1111cannabiscompany">11:11 Cannabis Company</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1849-extracts">1849 Extracts</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/18twelve">18twelve</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1906-new-highs">1906 New Highs</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1937-vireo">1937 Cannabis</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1937-concentrates">1937 Concentrates</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/19forty">19Forty Los Angeles</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1cbd">1CBD</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/1lyfe">1Lyfe</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/22-red">22 Red</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/220-farms">220 Farms</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/27-life">27 Life</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/27-pure">27 Pure</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/2wisted">2wisted</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3-bros">3 Bros Grow</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3-docs-extracts">3 DOCS EXTRACTS</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3-leaf">3 Leaf</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/brand-3-2-4">324</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/34-street-seed-co">34 Street Seed Co.</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3c-farms">3C Farms</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3d-farms">3D Farms</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/3leaf-edibles">3Leaf Edibles</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/420-bomb">420 Bomb</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/420-green-cannabis">420 Green Cannabis</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/420me">420ME</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/48north">48North</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/4score">4SCORE</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/5-leaf">5 Leaf</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/528-cannabis-co">528 Cannabis Co.</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/7-points-oregon">7 Points Oregon</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/710-labs">710 Labs</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/7acres">7ACRES</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/7leafok">7LeafOK</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/818-brands">818 Brands</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/818-genetics">818 Genetics</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/9-trees">9Trees</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/a-golden-state">A Golden State</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/emg-distribution">A to B Gardens</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/a-extract">A+ Extract</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/a-liv">A-LIV</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/a88cbd">A88CBD</a></li><li class="all__BrandsAllListItem-sc-1410m2d-6 kLYBAG"><a href="/brands/abba-medix">Abba Medix</a></li></div>

我已经实现了这种方式，但没有成功。

list = driver.find_elements_by_xpath('//*[@id="content"]/div[2]/div[2]/ul/div/li[1]/a')
list = [li.get_attribute('href') for li in list]
print(list)

如何刮掉所有的 li 标签？

标签： pythonhtmlselenium

Answer 1

尝试这个：

from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

#wait until first element is visible
wait.until(EC.visibility_of_element_located((By.XPATH, '//li[contains(@class,'all__BrandsAllListItem')]')))
#add some more delay to make sure all the other elements are loaded
time.sleep(1)

list = driver.find_elements_by_xpath('//li[contains(@class,'all__BrandsAllListItem')]/a')
list = [a.get_attribute('href') for a in list]
print(list)