python - Scrapy 不断给我错误的 AttributeError: 'str' object has no attribute 'text'

Question

我一直在尝试构建一个聚合器，但我一直在收到标题中所述的错误：AttributeError: 'str' object has no attribute 'text'

import requests
from scrapy.linkextractors import LinkExtractor

query = input()
request = requests.get('https://google.com/search?', 
                       params={'q':query})

getLink = LinkExtractor()
for link in getLink.extract_links(request.text):
    print(link)

标签： pythonweb-scrapingscrapy

Answer 1

LinkExtractor 需要在 Scrapy 蜘蛛中工作，参数是 Scrapy 响应，它不是字符串对象：

def parse(self, response):
    for link in self.link_extractor.extract_links(response):
        yield Request(link.url, callback=self.parse)