I would like to scrap articles from https://www.msn.com/de-at/autos/motorrad/
This is the main url on which all articles are listed. Each article url matches this format:
So I would like the actor to revisit the “Base-Url” on each run to check if there are any new subpages. But for my understanding after visiting https://www.msn.com/de-at/autos/motorrad/ for the first time. The actor puts the url into “visited” and won’t revisit until I clear the requestQueue?