Site returning a 406 unacceptable when trying to crawl


#1

Im trying to call a certain URL and it renders properly on web. It was crawling correctly for a while and recently started showing a 406 unacceptable error.


#2

Hi @clekkal,

I can be lots of issues. I need to know more details about your crawler:

  • did you use actor(Apify SDK) or crawler?
  • did you use the proxy?

I think proxy can be an issue. You can try to use other proxy IPs in Proxy Groups settings.


#3

Hi,
Thank You for the reply. I was using the crawler. I tried using actors as well and get the same issue. I’ll try using puppeteer and see if that issue is resolved.


#4

Let me know if you do it.

If you want to I can test it but I need website URL.