pythonselenium-webdriver

Using Python's Selenium, a page displays blank although it's displayed correctly using normal browsing

I'm trying to display a login page to allow me to download data from my energy provider.

I'm using Python Selenium.

Here's my code :

import time
from selenium import webdriver
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC

# Step 1: Start Selenium WebDriver
driver = webdriver.Firefox()  # Ensure options are passed correctly
driver.get("https://particulier.edf.fr/bin/edf_rc/servlets/sasServlet?processus=TDB")  # Replace with the actual login page URL

# Step 2a: Wait for the "Tout Accepter" button and click it
accept_button = WebDriverWait(driver, 10).until(EC.element_to_be_clickable((By.ID, "popin_tc_privacy_button_3")))
accept_button.click()

time.sleep(5.0)
driver.quit()

But it displays a blank result after the click is done. It's weird because when using a "normal" browser, it does redirect correctly to the correct login page. I tried both classic and incognito mode and it works.

I tried using Chrome a Firefox driver to the same result.

There may be some redirection shenanigans there but I'm unable to understand what, and how to circumvent this.

Any help ? Thanks, Beb

Solution

  • It is displaying blank page because website is detecting the bot(selenium) and is not allowing to interact with it. In such cases, you can use third party libraries to bypass the bot detection. One such python library is undetected_chromedriver.

    Refer the below working code:

    import time
from selenium.webdriver.common.by import By
from selenium.webdriver.support.ui import WebDriverWait
from selenium.webdriver.support import expected_conditions as EC
import undetected_chromedriver as uc

options = uc.ChromeOptions()
options.add_argument("--no-sandbox")
options.add_argument("--disable-blink-features=AutomationControlled")

driver = uc.Chrome(options=options)
driver.get("https://particulier.edf.fr/bin/edf_rc/servlets/sasServlet?processus=TDB")
driver.maximize_window()
wait = WebDriverWait(driver, 10)

# Step 2a: Wait for the "Tout Accepter" button and click it
wait.until(EC.element_to_be_clickable((By.ID, "popin_tc_privacy_button_3"))).click()

time.sleep(10)
driver.quit()

    Note: Ensure you add/import the undetected_chromedriver library into your IDE.