抓取链接 :http://36kr.com/search/newsflashes/%E8%9E%8D%E8%B5%84?page=1&ts=1534140047532
代码:
from bs4 import BeautifulSoup
import requests
url = 'http://36kr.com/search/newsflashes/%E8%9E%8D%E8%B5%84?page=1&ts=1534140047532'
wb_data = requests.get(url)
soup = BeautifulSoup(wb_data.text,'lxml')
titles = soup.select('span.title')
print(titles)
只能返回【】,改User-Agent也没有用。