python - 如何使用 Beautifulsoup 基于嵌套标签对文本进行切片和重组？

Question

在下面的 html 中，我需要按顺序阅读所有文本，并为每个 span 类组合单独的句子。

<label for="01">"The traveler, with his powerful "
    <span class ="Wizard">"Storm"</span>
    <span class ="Warrior">"Whirlwind"</span>
    <span class ="Monk">"Prayer"</span>", took down the dark forces of evil. The "
    <span class ="Wizard">"wizard"</span>
    <span class ="Warrior">"warrior"</span>
    <span class ="Monk">"monk"</span>" was exhausted afterwards and needed to take a rest."
</label>

在这种情况下，列表列表中应该有 3 个单独的句子和相应的类 - 所以输出将如下所示：

[['Wizard', 'The traveler, with his powerful Storm, took down the dark forces of evil. The wizard was exhausted afterwards and needed to take a rest.']
['Warrior', 'The traveler, with his powerful Whirlwind, took down the dark forces of evil. The warrior was exhausted afterwards and needed to take a rest.']
['Monk', 'The traveler, with his powerful Prayer, took down the dark forces of evil. The monk was exhausted afterwards and needed to take a rest.']]

我不知道如何解决这个问题，也无法在网上找到任何东西 - 可能是因为我不确定如何提出我的问题（如果您有建议如何更好地提出我的问题，请发表评论，我将要）。

先感谢您！

编辑：我试过了find(text=True)，find_all(text=True)但我不知道该怎么做。

标签： pythonpython-3.xweb-scrapingbeautifulsoup

Answer 1

您可以使用itertools.groupby

import bs4
from bs4 import BeautifulSoup as soup
from itertools import groupby
d = [(a, list(b)) for a, b in groupby(list(filter(lambda x:x != '\n', soup(content, 'html.parser').label.contents)), key=lambda x:isinstance(x, bs4.element.NavigableString))]
users, _text = list(zip(*[b for a, b in d if not a])), [b for a, b in d if a]
result = [[a[0]['class'][0], (lambda x:''.join(f'{j[1:-1]} {next(x).text[1:-1]}' if l < len(_text) - 1 else j[1:-2] for l, [j] in enumerate(_text)))(iter(a))] for a in users]

输出中有一些额外\n的字符，您可以使用以下命令删除它们re：

import re
final_result = [[a, re.sub('"\n\s+', '', b)] for a, b in result]

输出：

[['Wizard', 'The traveler, with his powerful Storm, took down the dark forces of evil. The wizard was exhausted afterwards and needed to take a rest.'], 
 ['Warrior', 'The traveler, with his powerful Whirlwind, took down the dark forces of evil. The warrior was exhausted afterwards and needed to take a rest.'], 
 ['Monk', 'The traveler, with his powerful Prayer, took down the dark forces of evil. The monk was exhausted afterwards and needed to take a rest.']]