Suggestion - couldn’t you make it so that the custom config is processed in order and the results are cached and merged at the end? With this source:
- you would have to read the first page
- then check if link single/next page exists
- if yes all these read out
- bring everything together.
body: //div[contains(concat(’ ‘,normalize-space(@class),’ ‘),’ item-content ‘)]
single_page_link: //a[contains(@href, ‘slide=1’)]
next_page_link: //a[contains(@href, ‘slide=’) and ./div[contains(@class, ‘fa-angle-right’)]]/@href
body: //div[contains(concat(’ ‘,normalize-space(@class),’ ‘),’ content ')]
test_url: https://guestofaguest.com/new-york/restaurants/the-10-trendiest-outdoor-brunch-spots-in-nyc