时间戳

首页 > 解决方案 > Web Scraping 遇到 XML 解析错误，如何修复？

python - Web Scraping 遇到 XML 解析错误，如何修复？

问题描述

我一直在使用网络抓取应用程序一年左右，现在没有真正的问题。今天早上，我运行程序并从 xml.etree 得到一个不匹配的标签错误。这在今天早上之前从来没有发生过，所以我有点难为为什么会突然发生这种情况。这是我的代码：

import requests
from xml.etree import ElementTree as ET
import json
import datetime as dt
import time
from dateutil import parser
from bs4 import BeautifulSoup
from xml.parsers import expat


url = 'https://www5.fdic.gov/cra/WebServices/DBService.asmx/callWS'

r = requests.post(url, data={"functionName":"SearchCRA","parmsJSON":"{\"Appl_Number\":\"\",\"Appl_Type\":\"\",\"PSTALP\":\"\",\"SUPRV_FDICDBS\":\"09\",\"BANK_NAME\":\"\"}"})
soup = BeautifulSoup(r.text, 'html.parser')

root = ET.fromstring(r.content)
data = json.loads(root.text)

today = dt.date.today()
lastweek = today-dt.timedelta(7)
date = lastweek.strftime("%m/%d/%Y") #one week from today in mm/d/yyyy

mylist = []
for result in data['Result']:
    d = parser.parse(result['Appl_Recd_YMD'])
    f_d = d.strftime("%m/%d/%Y")

    if f_d >= date:
        new_status = "***NEW***"
    else:
        new_status = "        "

if 'INTERIM' not in result['Instname'] and result['Inst_Rle_Cde'] == '1' and result['Appl_Type'] in ('REORG ', 'MERGER', 'RELMO', 'FDINEW'):
    output4 = 'Date: {} Application Number: {} Institution: {} State: {} Type: {} Link: https://www5.fdic.gov/cra/cram03.aspx?inApplNb={}&inApplType={} {}'.format(f_d, result['Appl_Number'], result['Instname'].strip(),result['Pstalp'], result['Appl_Type'],result['Appl_Number'], result['Appl_Type'], new_status)
    item = output4
    mylist.append(item)
    slist = sorted(mylist)
    print(len(mylist), end=""),
    print('.)', end = ""),
    print(output4)
    global slist2
    slist2 = slist

这是我得到的错误：

  File "C:/Users/d1rjr03/PycharmProjects/Discovery/FDIC.py", line 16, in <module>
root = ET.fromstring(r.content)
  File "C:\Python37\lib\xml\etree\ElementTree.py", line 1315, in XML
parser.feed(text)
xml.etree.ElementTree.ParseError: mismatched tag: line 7, column 2

这个错误让我想知道它是网站的问题还是只是我的访问权限？

我对 xml.etree 没有丰富的经验，所以我不太确定从哪里开始解决这种情况。知道为什么会突然发生这种情况吗？

标签： pythonxmlxml-parsingpython-requestsxml.etree

解决方案

在将 r.content 传递给 ET.fromstring 之前先看看它的值，这是您所期望的吗？将其打印到屏幕上，将其写入日志文件或使用调试器运行代码并检查值。从错误中它表明该值不会是您认为的那样

推荐阅读