python - How can I find an element looping through a list of divs using Selenium?

Question

In an HTML file structured like this:

<div class="card">
    <div class="id">
        ID: 123456
    </div>
    <div class="title">
        Title 1
    </div>
    <div class="description">
        Description 1
    </div>
</div>

<div class="card">
    <div class="id">
        ID: 89123
    </div>
    <div class="title">
        Title 2
    </div>
</div>

Let's say that I have a variable number of divs with the class "card", using Selenium I would like to loop through these divs and if there is div with the class description, I would like to print his text. I tried to do something like code below, but using find_element_by_xpath. I will always get the first element that has the class "description". How can I fix this and properly-getting elements by looping through divs? Thanks a lot.

cards = webdriver.find_elements_by_xpath("//div[@class='main-div']")

for card in cards:
    try:
        description = card.find_element_by_xpath("//div[@class='description']")
        print(description.text)
    except:
        print("No description")

标签： pythonhtmlseleniumselenium-webdriverweb-scraping

Answer 1

只.用于intermediate子标签。所以应该是这样的

card.find_element_by_xpath(".//div[@class='description']")

代码在这里：

cards = webdriver.find_elements_by_xpath("//div[@class='card']")

for card in cards:
    try:
        description = card.find_element_by_xpath(".//div[@class='description']")
        print(description.text)
    except:
        print("No description")