4) try: search_button = WebDriverWait(driver, 30).until( EC.element_to_be_clickable(( By.XPATH, "//a[.//svg[@aria-label='Search'] and .//span[normalize-space()='Search']]" )) ) # Scroll the element into view just in case driver.execute_script("arguments[0].scrollIntoView(true);", search_button) search_button.click() except TimeoutException: print("Search button not clickable.")
And I have have tried all of these with residential proxies, data center proxies and at different timeout lengths, NOTHING works and there is nothing that I can find in the documentation to help with this issue.
does anyone have any insight into this??
I'd understand if this was failing to even sign in but it is failing at the search button, is the page rendered differently for Apify than it is if your running this from your computer maybe?
In such a context, I would recommend starting with a debug using screenshots when running on the Apify platform and saving them to key-value storage. That way you can get a better understanding of what the problem is. Also test the crawler locally with the same proxy configuration
Any crawler may work differently locally and in the cloud, for example because of proxy (if you didn't use proxy locally). For example Youtube doesn't show some popup windows for me because Ukraine doesn't have GDPR. However, when crawler works with European proxies these popups will.