首页 > 解决方案 > 在网络爬虫中返回 302

问题描述

我模拟登录后,尝试发布原网站时返回302,在Chrome中打开原网站时返回415。

我尝试了几种方法:

session.post(url,headers = headers,data = data)

requests.post(url,headers = headers,data = data)

urllib.request.urlopen.read(url).decode()

import requets
import json
header = {'Host': 'sty.js118114.com:8080',
          'Connection': 'keep-alive',
          'Content-Length': '8188',
          'Accept': '*/*',
          'X-Requested-With': 'XMLHttpRequest',
          'User-Agent': 'Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/76.0.3809.100 Safari/537.36',
          'Content-Type': 'text/plain;charset=UTF-8;application/xml',
          'Origin': 'http://sty.js118114.com:8080',
          'Referer':
'http://sty.js118114.com:8080/Report/report/movecar_list.html',
          'Accept-Encoding': 'gzip, deflate',
          'Accept-Language': 'zh-CN,zh;q=0.9',
          'Cookie': cookie_name + '=' + cookie_value
}
data = {"calling_no":"","begin_time":"","end_time":"","called_car_no":""}
res = requests.post(target,data = json.dumps(data),headers = header)
print(res.content.decode())



我希望内容必须是 json 版本或 html 版本,以便我可以使用 re model 或 xpath 来获取我想要的信息。(没有任何重定向

最后,我提供有关该问题的必要信息:

Chrome Network

General

Request URL: http://sty.js118114.com:8080/Report/movecar/list/1/10

Request Method: POST

Status Code: 200 OK

Remote Address: 127.0.0.1:8888

Referrer Policy: no-referrer-when-downgrade

Response Headers

Content-Length: 8150

Content-Type: application/json;charset=UTF-8

Date: Thu, 22 Aug 2019 00:47:51 GMT

Server: Apache-Coyote/1.1

Request Headers

Accept: */*

Accept-Encoding: gzip, deflate

Accept-Language: zh-CN,zh;q=0.9

Content-Length: 66

Content-Type: text/plain;charset=UTF-8;

Cookie: JSESSIONID=0A474B00017BFFD89A515B336F482905

Host: sty.js118114.com:8080

Origin: http://sty.js118114.com:8080

Proxy-Connection: keep-alive
Referer: http://sty.js118114.com:8080/Report/report/movecar_list.html

User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36

(KHTML, like Gecko) Chrome/76.0.3809.100 Safari/537.36

X-Requested-With: XMLHttpRequest

Request Payload

{calling_no: "", begin_time: "", end_time: "", called_car_no: ""}

begin_time: ""
called_car_no: ""
calling_no: ""
end_time: ""

Fiddler Inspectors Raw

POST http://sty.js118114.com:8080/Report/movecar/list/1/10 HTTP/1.1

Host: sty.js118114.com:8080

Connection: keep-alive

Content-Length: 66

Accept: */*

X-Requested-With: XMLHttpRequest

User-Agent: Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 

(KHTML, like Gecko) Chrome/76.0.3809.100 Safari/537.36

Content-Type: text/plain;charset=UTF-8;

Origin: http://sty.js118114.com:8080

Referer: http://sty.js118114.com:8080/Report/report/movecar_list.html

Accept-Encoding: gzip, deflate

Accept-Language: zh-CN,zh;q=0.9

Cookie: JSESSIONID=0A474B00017BFFD89A515B336F482905

{"calling_no":"","begin_time":"","end_time":"","called_car_no":""}

Response Raw

HTTP/1.1 200 OK

Server: Apache-Coyote/1.1

Content-Type: application/json;charset=UTF-8

Date: Thu, 22 Aug 2019 00:27:59 GMT

Content-Length: 8150

标签: python

解决方案


推荐阅读