Beautifulsoup不返回页面的完整HTML

Beautifulsoup不返回页面的完整HTML

该页面使用JS来动态加载数据，因此您必须使用硒。检查以下代码。请注意，您必须安装selenium和chromedrive（将文件解压缩并复制到python文件夹中）

import timefrom bs4 import BeautifulSoupfrom selenium import webdriverfrom selenium.webdriver.chrome.options import Optionsurl = "https://www.sofascore.com/pt/futebol/2018-09-18"options = Options()options.add_argument('--headless')options.add_argument('--disable-gpu')driver = webdriver.Chrome(chrome_options=options)driver.get(url)time.sleep(3)page = driver.page_sourcedriver.quit()soup = BeautifulSoup(page, 'html.parser')container = soup.find_all('div', attrs={    'class':'js-event-list-tournament-events'})print(container)

或者您可以使用他们的json API

import requestsurl = 'https://www.sofascore.com/football//2018-09-18/json'r = requests.get(url)print(r.json())