python - 如何提取网页中嵌入的视频链接名称以及视频名称
问题描述
我正在尝试从网页中提取所有视频链接参考以及视频名称,我尝试了以下代码。
#!/usr/bin/python3
from bs4 import BeautifulSoup
import requests
import urllib
url = urllib.request.urlopen('https://www.ansible.com/resources/videos').read()
acc_link = BeautifulSoup(url, features="lxml")
for line in acc_link.find_all('a'):
print(line.get('href'))
输出:
https://www.ansible.com/?hsLang=en-us
https://www.ansible.com/overview/it-automation?hsLang=en-us
https://www.ansible.com/overview/it-automation?hsLang=en-us
https://www.ansible.com/overview/how-ansible-works?hsLang=en-us
https://www.ansible.com/products/automation-platform?hsLang=en-us
https://www.ansible.com/use-cases?hsLang=en-us
https://www.ansible.com/use-cases/provisioning?hsLang=en-us
https://www.ansible.com/use-cases/configuration-management?hsLang=en-us
https://www.ansible.com/use-cases/application-deployment?hsLang=en-us
https://www.ansible.com/use-cases/continuous-delivery?hsLang=en-us
https://www.ansible.com/use-cases/security-automation?hsLang=en-us
https://www.ansible.com/use-cases/orchestration?hsLang=en-us
https://www.ansible.com/integrations?hsLang=en-us
HTML源代码例如:
<h4><a href="https://www.ansible.com/resources/webinars-training/ansible-network-automation-with-arista-cloudvision-and-arista?hsLang=en-us">Ansible Network Automation with Arista CloudVision and Arista Validated Designs</a></h4>
像上面一样只是链接的 HTML 源代码的示例https://www.ansible.com/resources/videos我想要链接名称https://www.ansible.com/resources/webinars-training/ansible-network-automation-with-arista-cloudvision-and-arista
和视频名称Ansible Network Automation with Arista CloudVision and Arista Validated Designs
。
下面是我href
之前想要的另一个例子,?
并且a
重视 ie Scale-out Clustering with Tower 3.1
。
<h4><a href="https://www.ansible.com/scale-out-clustering-tower?hsLang=en-us">Scale-out Clustering with Tower 3.1</a></h4>
期望的输出:
影片名称:采用 Arista CloudVision 和 Arista 验证设计的 Ansible 网络自动化
感谢您的帮助。
解决方案
如果您想要href
来自所有锚点,那么您可以使用 css 选择'a[href]'
,它只会找到具有href
属性的锚点标签:
您确实进行了如下调整,
#!/usr/bin/python3
from bs4 import BeautifulSoup
import requests
import urllib
url = urllib.request.urlopen('https://www.ansible.com/resources/videos').read()
acc_link = BeautifulSoup(url, features="lxml")
for article in acc_link.find_all('div', class_='card-body'):
# this will grab the name of the video article
headline1 = article.h4.a.text
# this will get your video link
headline2 = article.select_one('a[href]')['href'].split('?')[0]
#headline2 = headline2.split('?')[0]
print(headline1)
# I have placed the condition as few of the link address do not have
# the site link prefix www.ansible.com.
if 'www' in headline2:
print(headline2)
else:
print('https://www.ansible.com' + headline2)
print()
结果:
Automating Monitoring with the Sensu Go Ansible Collection
https://www.ansible.com/resources/webinars-training/automating-monitoring-with-the-sensu-go-ansible-collection
How to load balance a hybrid cloud using Red Hat Insights, Red Hat Ansible, and Red Hat AMQ Interconnect
https://www.redhat.com/en/about/videos/road-to-open-hybrid-cloud-part-2
British Army speeds service delivery with Red Hat
https://www.redhat.com/en/about/videos/british-army-speeds-service-delivery-red-hat
Zero To 100 - Rapid deployment with Ansible Tower
https://www.ansible.com/zero-to-100
Scale-out Clustering with Tower 3.1
https://www.ansible.com/scale-out-clustering-tower
What's New In Tower 3.1
https://www.ansible.com/whats-new-tower-3-1
Amelco - Continuous Delivery with Ansible Tower
https://www.ansible.com/success-stories/amelco
Runnable - Getting Started with Ansible
https://www.ansible.com/success-stories/runnable
Fatmap - App Deployment with Ansible
https://www.ansible.com/success-stories/fatmap
Splunk and Ansible Tower
https://www.ansible.com/success-stories/splunk
Siemens - Delivering Automation to the Cloud
https://www.ansible.com/success-stories/siemens
Ansible Tower 10 min demo
https://www.ansible.com/products/tower/demo
Ansible Tower 3.1
https://www.ansible.com/tower-workflows-demo
Ansible Tower 2-min Overview
https://www.ansible.com/tower-overview
Ansible Quick Start
https://www.ansible.com/resources/videos/quick-start-video
Ansible + AWS - Serverless Deploys
https://www.ansible.com/resources/videos/ansible-aws-automate-serverless-application-deploys-with-ansible
Ansible + AWS - EC2 Provisionling
https://www.ansible.com/resources/videos/ansible-aws-automate-ec2-provisioning-with-red-hat-ansible-engine-and-red-hat-ansible-tower
Network Automation For Beginners
https://www.ansible.com/resources/videos/network-automation-with-red-hat-ansible-engine-for-beginners
Agnostic Network Automation Examples with Ansible and Juniper NRE Labs
https://www.ansible.com/blog/agnostic-network-automation-examples-with-ansible-and-juniper-nre-labs
How useful is Ansible in a cloud-native Kubernetes environment
https://www.ansible.com/blog/how-useful-is-ansible-in-a-cloud-native-kubernetes-environment
我希望这会有所帮助。
推荐阅读
- javascript - 吞咽用户参考。无法读取未定义的属性“替换”
- python - python中16b十六进制的数学运算
- javascript - 如何创建单元测试来验证此代码
- swift - 如何在 Swift 中说出字符串时在文本到语音中进行 1-5 秒的小停顿?
- java - 为正确的数学结果制定代码时遇到问题
- javascript - 无法使用 preventDefault() 以编程方式检查单选按钮
- python - 为什么屏幕不能以 Kv 语言加载?
- multithreading - 通过将 FnMut 包装成 Weak 将其发送到其他线程
> 抱怨缺少发送 - r - 如何在R中绘制多线图
- r - 手动留下一个交叉验证