python - 如何使用请求从链接收集和移动数据到熊猫数据框
问题描述
我有一个链接如下:
https://beta.nseindia.com/api/snapshot-derivatives-equity?index=futures
我想使用请求收集表数据并将其从链接移动到 pandas Dataframe
解决方案
先用requests.get
再用json.json_normalize
:
import pandas as pd
import json
import requests
from pandas.io.json import json_normalize
url = "https://beta.nseindia.com/api/snapshot-derivatives-equity?index=futures"
result = requests.get(url).json()
#print (result)
df = json_normalize(result['volume'], 'data','timestamp')
print (df)
underlying identifier instrumentType \
0 DLF FUTSTKDLF29-08-2019XX0.00 FUTSTK
1 YESBANK FUTSTKYESBANK29-08-2019XX0.00 FUTSTK
2 LICHSGFIN FUTSTKLICHSGFIN29-08-2019XX0.00 FUTSTK
3 IBULHSGFIN FUTSTKIBULHSGFIN29-08-2019XX0.00 FUTSTK
4 TATAMOTORS FUTSTKTATAMOTORS29-08-2019XX0.00 FUTSTK
5 SBIN FUTSTKSBIN29-08-2019XX0.00 FUTSTK
6 ICICIBANK FUTSTKICICIBANK29-08-2019XX0.00 FUTSTK
7 YESBANK FUTSTKYESBANK26-09-2019XX0.00 FUTSTK
8 JINDALSTEL FUTSTKJINDALSTEL29-08-2019XX0.00 FUTSTK
9 DLF FUTSTKDLF26-09-2019XX0.00 FUTSTK
10 VEDL FUTSTKVEDL29-08-2019XX0.00 FUTSTK
11 ASHOKLEY FUTSTKASHOKLEY29-08-2019XX0.00 FUTSTK
12 BANKBARODA FUTSTKBANKBARODA29-08-2019XX0.00 FUTSTK
13 NMDC FUTSTKNMDC29-08-2019XX0.00 FUTSTK
14 SAIL FUTSTKSAIL29-08-2019XX0.00 FUTSTK
15 PNB FUTSTKPNB29-08-2019XX0.00 FUTSTK
16 NCC FUTSTKNCC29-08-2019XX0.00 FUTSTK
17 IDEA FUTSTKIDEA29-08-2019XX0.00 FUTSTK
18 TATAPOWER FUTSTKTATAPOWER29-08-2019XX0.00 FUTSTK
19 GMRINFRA FUTSTKGMRINFRA29-08-2019XX0.00 FUTSTK
20 NIFTY FUTIDXNIFTY29-08-2019XX0.00 FUTIDX
21 NIFTY FUTIDXNIFTY26-09-2019XX0.00 FUTIDX
22 NIFTY FUTIDXNIFTY31-10-2019XX0.00 FUTIDX
23 BANKNIFTY FUTIDXBANKNIFTY29-08-2019XX0.00 FUTIDX
24 BANKNIFTY FUTIDXBANKNIFTY26-09-2019XX0.00 FUTIDX
25 BANKNIFTY FUTIDXBANKNIFTY31-10-2019XX0.00 FUTIDX
26 NIFTYIT FUTIDXNIFTYIT29-08-2019XX0.00 FUTIDX
27 NIFTYIT FUTIDXNIFTYIT31-10-2019XX0.00 FUTIDX
28 NIFTYIT FUTIDXNIFTYIT26-09-2019XX0.00 FUTIDX
instrument expiryDate optionType strikePrice lastPrice pChange \
0 Stock Futures 29-Aug-2019 - 0 146.90 -14.617844
1 Stock Futures 29-Aug-2019 - 0 61.90 -5.351682
2 Stock Futures 29-Aug-2019 - 0 429.00 -6.931337
3 Stock Futures 29-Aug-2019 - 0 441.25 -7.832898
4 Stock Futures 29-Aug-2019 - 0 110.70 -1.512456
5 Stock Futures 29-Aug-2019 - 0 276.25 -0.575850
6 Stock Futures 29-Aug-2019 - 0 407.35 -1.356096
7 Stock Futures 26-Sep-2019 - 0 61.95 -5.275229
8 Stock Futures 29-Aug-2019 - 0 98.40 -0.656234
9 Stock Futures 26-Sep-2019 - 0 147.20 -14.765489
10 Stock Futures 29-Aug-2019 - 0 135.05 -3.397711
11 Stock Futures 29-Aug-2019 - 0 60.45 -2.578566
12 Stock Futures 29-Aug-2019 - 0 92.80 -2.161307
13 Stock Futures 29-Aug-2019 - 0 83.20 -3.981535
14 Stock Futures 29-Aug-2019 - 0 31.35 0.000000
15 Stock Futures 29-Aug-2019 - 0 62.60 -2.263856
16 Stock Futures 29-Aug-2019 - 0 52.40 -4.640582
17 Stock Futures 29-Aug-2019 - 0 5.55 0.000000
18 Stock Futures 29-Aug-2019 - 0 53.25 4.105572
19 Stock Futures 29-Aug-2019 - 0 14.70 0.000000
20 Index Futures 29-Aug-2019 - 0 10852.60 -0.732210
21 Index Futures 26-Sep-2019 - 0 10889.05 -0.779527
22 Index Futures 31-Oct-2019 - 0 10935.80 -0.716315
23 Index Futures 29-Aug-2019 - 0 27506.55 -0.840850
24 Index Futures 26-Sep-2019 - 0 27617.45 -0.836611
25 Index Futures 31-Oct-2019 - 0 27715.00 -0.733707
26 Index Futures 29-Aug-2019 - 0 15543.00 -0.333440
27 Index Futures 31-Oct-2019 - 0 0.00 -100.000000
28 Index Futures 26-Sep-2019 - 0 0.00 -100.000000
openPrice highPrice lowPrice numberOfContractsTraded totalTurnover \
0 169.40 169.50 137.65 26605 110979.607200
1 66.60 67.50 61.15 20869 29591.096920
2 436.00 439.00 420.90 16967 80552.595750
3 466.85 467.00 436.25 16875 60661.722720
4 111.80 114.00 110.10 5833 19685.286000
5 277.60 277.85 275.00 5355 44992.392000
6 411.60 413.30 407.25 4560 30347.780100
7 66.60 67.40 61.25 3479 4919.398880
8 98.00 99.40 96.05 3287 10310.977600
9 168.55 168.55 138.20 3177 13129.984000
10 138.30 138.85 133.80 2231 9102.480000
11 62.20 62.60 60.35 2181 8124.861600
12 94.60 94.90 92.50 1931 8237.600100
13 89.30 90.00 82.80 1811 9555.801600
14 31.30 31.60 30.75 1559 5930.371200
15 64.00 64.30 62.35 1549 6898.260600
16 54.25 55.00 52.20 1538 6651.317600
17 5.50 5.70 5.35 1212 1871.100000
18 51.00 53.65 50.90 894 4260.600000
19 14.75 15.00 14.55 292 1976.683500
20 10910.40 10917.85 10850.30 39243 328770.326700
21 10955.00 10958.45 10886.35 7243 61018.946220
22 10989.55 10989.55 10931.00 330 2761.158960
23 27715.00 27746.05 27505.60 38495 218171.425716
24 27810.10 27810.10 27610.70 2563 14438.541018
25 27833.15 27847.00 27715.00 115 638.754620
26 15550.00 15575.00 15494.00 36 279.648360
27 0.00 0.00 0.00 0 0.000000
28 0.00 0.00 0.00 0 0.000000
premiumTurnover openInterest underlyingValue timestamp
0 1.109796e+10 15726 146.50 22-Aug-2019 10:36:21
1 2.959110e+09 76008 61.95 22-Aug-2019 10:36:21
2 8.055260e+09 10533 429.80 22-Aug-2019 10:36:21
3 6.066172e+09 27949 443.95 22-Aug-2019 10:36:21
4 1.968529e+09 25079 110.40 22-Aug-2019 10:36:21
5 4.499239e+09 33409 275.75 22-Aug-2019 10:36:21
6 3.034778e+09 54895 408.90 22-Aug-2019 10:36:21
7 4.919399e+08 13816 61.95 22-Aug-2019 10:36:21
8 1.031098e+09 10335 98.40 22-Aug-2019 10:36:21
9 1.312998e+09 1110 146.50 22-Aug-2019 10:36:21
10 9.102480e+08 20821 135.00 22-Aug-2019 10:36:21
11 8.124862e+08 14751 60.55 22-Aug-2019 10:36:21
12 8.237600e+08 12955 92.75 22-Aug-2019 10:36:21
13 9.555802e+08 5176 83.00 22-Aug-2019 10:36:21
14 5.930371e+08 8065 31.40 22-Aug-2019 10:36:21
15 6.898261e+08 14087 62.60 22-Aug-2019 10:36:21
16 6.651318e+08 5343 52.45 22-Aug-2019 10:36:21
17 1.871100e+08 15059 5.60 22-Aug-2019 10:36:21
18 4.260600e+08 5617 53.45 22-Aug-2019 10:36:21
19 1.976684e+08 3076 14.75 22-Aug-2019 10:36:21
20 3.287703e+10 262448 10842.90 22-Aug-2019 10:36:21
21 6.101895e+09 45640 10842.90 22-Aug-2019 10:36:21
22 2.761159e+08 3701 10842.90 22-Aug-2019 10:36:21
23 2.181714e+10 87516 27472.70 22-Aug-2019 10:36:21
24 1.443854e+09 11998 27472.70 22-Aug-2019 10:36:21
25 6.387546e+07 614 27472.70 22-Aug-2019 10:36:21
26 2.796484e+07 207 15539.45 22-Aug-2019 10:36:21
27 0.000000e+00 0 15539.45 22-Aug-2019 10:36:21
28 0.000000e+00 5 15539.45 22-Aug-2019 10:36:21
推荐阅读
- javascript - WordPress 自定义插件开发中的纯 JavaScript 基本 AJAX 调用
- node.js - 这个错误对 nodejs 配置中的 MSAL 意味着什么?
- css - 选择父菜单
- powershell - 如何保持 io.filesystemwatcher 无限期运行
- java - 双向相互 SSL 身份验证
- angular - 算术运算的右侧必须是“any”、“number”、“bigint”类型或枚举类型
- c# - 关于使用指令和性能
- java - JBAS014775:新的缺失/不满足的依赖项:------ jboss.security.security-domain.java ---- WSADRealm
- assembly - 'pcmpeqb' 的延迟 - 内存与 xmm 寄存器
- c - 将进程 ID 从客户端发送到服务器