首页 > 解决方案 > 如何在 Python 和 beautifulsoup 中从 CDATA 中提取数据?

问题描述

我想从 cd 数据中提取 post_id

<script type='text/javascript' data-cfasync='false'>
  //<![CDATA[
    _SHR_SETTINGS = {"endpoints":{"local_recs_url":"https:\/\/klaudynahebda.pl\/wp-admin\/admin-ajax.php?action=shareaholic_permalink_related"},"url_components":{"year":"2018","monthnum":"06","day":"19","post_id":"21132","postname":"letnie-warsztaty-ziolowo-kosmetyczne-7-9lipiec","author":"admin"}};
  //]]>
</script>

我能够获取整个 CData 但不知道下一步该怎么做?

标签: pythonweb-scrapingbeautifulsoup

解决方案


也许这不是一个超级解决方案,但我明白了

from bs4 import BeautifulSoup

html = """
<script type='text/javascript' data-cfasync='false'>
//<![CDATA[
    _SHR_SETTINGS = {"endpoints":{"local_recs_url":"https:\/\/klaudynahebda.pl\/wp-admin\/admin-ajax.php?action=shareaholic_permalink_related"},"url_components":{"year":"2018","monthnum":"06","day":"19","post_id":"21132","postname":"letnie-warsztaty-ziolowo-kosmetyczne-7-9lipiec","author":"admin"}};
//]]>
</script>
"""

soup = BeautifulSoup(html, 'lxml')

dct = {}

for scr in soup.find_all('script'):
    for x in scr.text.split(','):
        if 'post_id' in x:
            k, v = x.replace('"', '').split(':')
            dct[k] = v

print(dct['post_id'])

输出

21132

推荐阅读