python - 解析从 Google 表格获取的 CSV
问题描述
我正在尝试解析从已发布的 Google 表格中获取的 CSV 数据。我正在使用简单的 http 请求获取 CSV 字符串。然后尝试用 csv python 库解析它。解析器似乎无法识别每行中的列数,但我不明白如何修复它。
我尝试了从磁盘文件中读取 csv 的相同代码,它运行良好。
import csv
import requests
response = requests.get('https://docs.google.com/spreadsheets/d/e/2PACX-1vThbG2jdBjBWpcW0iarJD2TtW6olqygCvuQHRI-fwnLx6jkIFtuyiF7Bm4rEPLo_jpjLmZsr9sYGs8e/pub?output=csv&gid=784986591')
csv_bytestream = response.content.decode()
csv.register_dialect('GoogleDialect', delimiter=',', quotechar='"', quoting=csv.QUOTE_MINIMAL)
reader = csv.reader(csv_bytestream, dialect='GoogleDialect')
print(" **** NOT WORKING CODE **** ")
print(csv_bytestream)
num_row = 0
for row in reader:
num_row += 1
print("Row {num} has {nelem} columns".format(num=str(num_row) ,nelem=str(len(row))))
print(row)
print(" **** WORKING CODE **** ")
with open('MyFile.csv','r', encoding='utf-8') as f:
print(f.read())
with open('MyFile.csv', 'r', encoding='utf-8') as f:
reader = csv.reader(f, dialect='GoogleDialect')
num_row = 0
for row in reader:
num_row += 1
print("Row {num} has {nelem} columns".format(num=str(num_row), nelem=str(len(row))))
print(row)
我期望两个输出都像:
Row 1 has 16 columns
['', 'Just insult, here and now!', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
Row 2 has 16 columns
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
...
虽然我从 NON WORKING 代码中得到的输出是这样的:
Row 1 has 2 columns
['', '']
Row 2 has 1 columns
['Just insult, here and now!']
Row 3 has 2 columns
['', '']
...
print(csv_bytestream)
和打印的内容print(f.read())
是一样的。如果我知道该怎么做,我会附上 csv 文件。
解决方案
问题在于编码!您正在获取的 csv 响应有ISO-8859-1
>>> response.encoding
>>>'ISO-8859-1'
这是可行的解决方案,可能会对您有所帮助
response = requests.get('https://docs.google.com/spreadsheets/d/e/2PACX-1vThbG2jdBjBWpcW0iarJD2TtW6olqygCvuQHRI-fwnLx6jkIFtuyiF7Bm4rEPLo_jpjLmZsr9sYGs8e/pub?output=csv&gid=784986591')
csv_bytestream = response.content.decode('utf-8')
cr = csv.reader(csv_bytestream.splitlines(), delimiter=',')
my_list = list(cr)
my_list = list(cr)
for row in my_list:
print(row)
示例响应:
['', 'Just insult, here and now!', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', 'STAGIONE CONTINUA', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', '', '', '', '', '', '', '', '', '', '', '', '', '', '', '']
['', 'Rank', 'Adj', 'Player', 'Rating', 'Adj', 'Dist', 'Played', '# Pet', '% Pet/Played', '# Best', '# Worst', '(B-W)%', 'Wins', 'Losses', '']
['', '1', '⇔ (1)', 'JTsuited', '1674', '0', '0', '335', '4', '1,19%', '92', '52', '11,94%', '176', '159', 'HALL OF FAME']
['', '2', '⇔ (2)', 'Nameless', '1662', '2', '12', '293', '7', '2,39%', '74', '43', '10,58%', '171', '122', '']
['', '3', '⇑ (5)', 'Takysis', '1562', '55', '100', '688', '36', '5,23%', '145', '130', '2,18%', '348', '340', '']
['', '4', '⇓ (3)', 'Sfinks', '1528', '-19', '34', '696', '77', '11,06%', '134', '154', '-2,87%', '380', '316', '']
['', '5', '⇓ (4)', 'Neristelrooy', '1522', '-24', '6', '521', '37', '7,10%', '75', '103', '-5,37%', '282', '239', '']
['', '6', '⇔ (6)', 'Starmanzo', '1411', '-4', '111', '450', '24', '5,33%', '92', '78', '3,11%', '210', '240', '']
['', '7', '⇔ (7)', 'Bruno', '1386', '-13', '25', '446', '33', '7,40%', '74', '89', '-3,36%', '214', '232', 'HALL OF SHAME']
['', '8', '⇑ (9)', 'Biru', '1350', '-13', '36', '792', '132', '16,67%', '103', '159', '-7,07%', '414', '378', '']
['', '9', '⇓ (8)', 'Alino', '1340', '-32', '10', '33', '1', '3,03%', '3', '5', '-6,06%', '13', '20', '']
['', '10', '⇑ (12)', 'starpa', '1246', '48', '94', '796', '62', '7,79%', '177', '124', '6,66%', '337', '459', '']
['', '11', '⇓ (10)', 'Praxy', '1237', '0', '9', '223', '35', '15,70%', '30', '46', '-7,17%', '111', '112', '']
['', '12', '⇓ (11)', 'Beatren', '1218', '0', '19', '213', '19', '8,92%', '43', '43', '0,00%', '92', '121', '']
['', '13', '⇔ (13)', 'staratlas', '1169', '0', '49', '75', '9', '12,00%', '6', '22', '-21,33%', '34', '41', '']
推荐阅读
- html - 仅使用 CSS 可以实现此背景吗?
- swift - 尝试根据单击的按钮切换弹出的照片 Xcode
- apache-kafka - 如何在 Kafka 中扩展到数千个生产者-消费者对?
- json - 无法使用 nifi 将 json 解组为对象
- postgresql - AWS DMS 转换规则未在目标 Postgres DB 上添加列
- azure - Azure Functions - 无法使用 VSCODE 扩展部署函数 - 部署在将 zip 包上传到存储容器时永远挂起
- android - 安卓外挂。如何录制流式 RTSP 视频
- python - 错误:命令出错,退出状态为 1:在 Heroku 上部署代码时
- javascript - Firebase v9 Beta 库的模块化使用
- java - 如何在 Java 中使用多核运行 Z3?