Ich versuche, mit Python und der Selenium-Bibliothek einen Web-Scraper zu erstellen ⇐ Python

[Guest]

Sobald ich versuche, eine Website zu crawlen, lädt sie den Browser in einer anderen Instanz, stürzt jedoch sofort ab. Der Code und der Fehler sind angehängt ->
Code:

Code: Select all

import selenium.webdriver as webdriver
from selenium.webdriver.chrome.service import Service
import time

def scrape_website(website):
print("Launching the browser!")

option=webdriver.ChromeOptions()
driver=webdriver.Chrome()
try:
driver.get(website)
print("The page is loaded now...")
html=driver.page_source
time.sleep(10)
return html
finally:
driver.quit()

Der Fehler:

Code: Select all

InvalidArgumentException: Message: invalid argument (Session info: chrome=131.0.6778.205)
Stacktrace: GetHandleVerifier [0x00007FF616866CC5+28821] (No symbol) [0x00007FF6167D3850]
(No symbol) [0x00007FF6166755B9] (No symbol) [0x00007FF616663051] (No symbol) [0x00007FF6166612FD] (No symbol) [0x00007FF616661B3C] (No symbol) [0x00007FF61667885A] (No symbol) [0x00007FF6167101FE] (No symbol) [0x00007FF6166EF2FA] (No symbol) [0x00007FF61670F412] (No symbol) [0x00007FF6166EF0A3] (No symbol) [0x00007FF6166BA778] (No symbol) [0x00007FF6166BB8E1] GetHandleVerifier [0x00007FF616B9FCCD+3408029] GetHandleVerifier [0x00007FF616BB743F+3504143] GetHandleVerifier [0x00007FF616BAB61D+3455469] GetHandleVerifier [0x00007FF61692BDCB+835995] (No symbol) [0x00007FF6167DEB6F] (No symbol) [0x00007FF6167DA824] (No symbol) [0x00007FF6167DA9BD] (No symbol) [0x00007FF6167CA1A9] BaseThreadInitThunk [0x00007FF85F087374+20] RtlUserThreadStart [0x00007FF86057CC91+33]

Ich verwende Streamlit, um das Frontend der Anwendung vorzubereiten. Der Code ist unten angehängt:

Code: Select all

import streamlit as st # type: ignore
from scrape import scrape_website

st.title("College Website Scraper")
url=st.text_input("Enter the Website Address:")

if st.button("Scrape Site"):
st.write("Scraping this Website")
result=scrape_website(url)
print(result)