Im trying to call a certain URL and it renders properly on web. It was crawling correctly for a while and recently started showing a 406 unacceptable error.
I can be lots of issues. I need to know more details about your crawler:
- did you use actor(Apify SDK) or crawler?
- did you use the proxy?
I think proxy can be an issue. You can try to use other proxy IPs in Proxy Groups settings.
Thank You for the reply. I was using the crawler. I tried using actors as well and get the same issue. I’ll try using puppeteer and see if that issue is resolved.
Let me know if you do it.
If you want to I can test it but I need website URL.