Apify and Crawlee Official Forum

Updated 5 months ago

Expand clickable elements setting - Website Content Crawler

At a glance
Hi there, I'm trying to scrape this website - https://www.msci.com/research-and-insights/, there's a load more button which I wish to click so that crawler extracts all the content.

I tried this setting in different ways but failing. The css selector for that element would be #research-items-load-more a . I tried setting values like ["#research-items-load-more a"=\"true\"] or just ['#research-items-load-more a']. It fails to run eventually.

Would appreciate quick help here.
m
L
2 comments
Hello, please prefer using actor Issues next time.

It does expand it but only once. I will let the team know and hopefully it can me upgraded
Add a reply
Sign up and join the conversation on Discord