Hi, I’d like to suggest an improvement for pagination scraping.
Currently, when Ultimate Web Scraper clicks “View more” / “Load more” and new hotel results are loaded, it appears to scan the entire result list again from the beginning. This causes previously extracted records to be processed repeatedly and makes large result sets slower and less efficient.
It would be very useful if the scraper could keep track of already extracted items and, after pagination or “Load more”, process only the newly loaded records.
For example:
First load: extract hotels 1–20
Click “Load more”
Second load: extract only hotels 21–40
Click “Load more”
Third load: extract only hotels 41–60
Instead of re-scanning hotels 1–20, then 1–40, then 1–60 each time.
A deduplication or “process only newly loaded elements” option for pagination/infinite scroll would make large scraping jobs significantly faster and reduce unnecessary page processing.
Please authenticate to join the conversation.
In Review
Feature Request
9 days ago

Ozge Arslan
Get notified by email when there are changes.
In Review
Feature Request
9 days ago

Ozge Arslan
Get notified by email when there are changes.