I am very new to crawling, and not a developer…but looking for some help if I may.
I would like to crawl all the pages under a url;
I know there are hundreds of pages under this address.
…article…and so on
I need to crawl for all pages under …\article\ and obtain from them the values
I naively thought i could use the apify/web-scraper template, which recursively returns the title of its pages, and just insert my URL, at least to get the title.
It only returns the title from the page …\article\ and none of the pages under it.
I would love some help to get me started on this journey!