首页 > 解决方案 > 如何从 API 响应中捕获所有失败的节点

问题描述

对于发出的每个请求,都会给出响应。我的目标是捕获所有返回 false 的节点。目前我只能存储最后的回复。

下面是一个失败响应的例子:

<?xml version="1.0" encoding="utf-8"?>
<lead_return_response xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://lead.com/api/2/">
  <success>false</success>
  <message>Lead is Already in Return List</message>
</lead_return_response>

这是我的代码块:

import requests
import json
import csv
from bs4 import BeautifulSoup


def return_leads():
    with open('return_leads.csv', 'r') as csv_file:  #opens csv file as var csv_file
        csv_reader = csv.DictReader(csv_file)  #csv.Dictreader turns values from csv 'returns_lead.csv' and converts to key values pairs

        for data in csv_reader:  #looping through data in csv file
            url = 'https://api.com.'  #request URL for API
            params={"api_key": "#########",  #api key is only static value
                    "lead_id": data['Lead ID'],  #passing dynamic values from csv to required API parameters
                    "vertical_id": data['Vertical ID'],
                    "buyer_contract_id": data['Buyer Contract ID'],
                    "return_type": data['Return Type'],
                    "return_reason_id": data['Return Reason ID'],
                    "reject_reason_id": data['Reject Reason ID']}
            req = requests.get(url, params=params)  #request is generated for each line item in the csv file
            print(req.text) #response from API request is captured

#Print Output:

<?xml version="1.0" encoding="utf-8"?>
<lead_return_response xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://cakemarketing.com/api/2/">
  <success>false</success>
  <message>Lead is Already in Return List</message>
</lead_return_response>

<?xml version="1.0" encoding="utf-8"?>
<lead_return_response xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://cakemarketing.com/api/2/">
  <success>false</success>
  <message>Lead is Already in Return List</message>
</lead_return_response>


<?xml version="1.0" encoding="utf-8"?>
<lead_return_response xmlns:xsd="http://www.w3.org/2001/XMLSchema" xmlns:xsi="http://www.w3.org/2001/XMLSchema-instance" xmlns="http://cakemarketing.com/api/2/">
  <success>false</success>
  <message>Lead is Already in Return List</message>
</lead_return_response>




            print(url, params) #check how params are being populated with dynamic data

#Print Output:

https://affiliates.ahs.com/api/2/track.asmx/ReturnLead {'api_key': '', 'lead_id': 'CB220BCB', 'vertical_id': '43', 'buyer_contract_id': '4', 'return_type': 'submit_for_approval', 'return_reason_id': '1', 'reject_reason_id': '0'}

https://affiliates.ahs.com/api/2/track.asmx/ReturnLead {'api_key': '', 'lead_id': 'D8E43B8D', 'vertical_id': '43', 'buyer_contract_id': '4', 'return_type': 'submit_for_approval', 'return_reason_id': '1', 'reject_reason_id': '0'}

https://affiliates.ahs.com/api/2/track.asmx/ReturnLead {'api_key': '', 'lead_id': '9B45E52E', 'vertical_id': '43', 'buyer_contract_id': '4', 'return_type': 'submit_for_approval', 'return_reason_id': '1', 'reject_reason_id': '0'}

            response = BeautifulSoup(req.text, 'lxml')
            print('response:', response)
            responseFalse = response.find('success').string
            responseMessage = response.find('message').string
            if responseFalse == 'false':
                captureResponse = []
                captureResponse.append(data['Lead ID'])
                captureResponse.append(responseFalse)
                captureResponse.append(responseMessage)

print('caputureResponse:', captureResponse)

#Print Output:

 ['9B45E52E', 'false', 'Lead is Already in Return List']

return_leads()

我的目标是让 captureResponse[] 包含所有 3 个失败的潜在客户,而不仅仅是最后一个。谁能纠正我在这里做错了什么?先感谢您!

标签: python-3.xweb-scraping

解决方案


只初始化一次

请初始化函数顶部附近的列表:

def return_leads():
    captureResponse = []
    with open( ...

您的代码在函数中,在for循环内部,在 false 测试中将其初始化为 waaayyy。

效果是将一个非常好的值 #1 放入列表中,然后我们将列表设置为 ,[]然后将一个非常好的值 #2 放入其中。并再次将其重置为[]值 #3 进入之前。

数据结构

此外,三个.append()电话可能不是您想要的。构造一个元组并附加它会更有意义:

            captureResponse.append((data['Lead ID'], responseFalse, responseMessage))

在单独的行上拆分元组可能会更清晰:

            summary = data['Lead ID'], responseFalse, responseMessage
            captureResponse.append(summary)

推荐阅读