Troubleshooting

Unable to scrape target

We are sometimes not able to scrape the requested target. Some possible reasons may be:

• The target URL returns 500, which we interpret as a failure.
• The target can only be reached from a specific country.
• The target times out (we retry automatically, but we give up after several retries).
• The target domain DNS name cannot be resolved.

It is not easy to deduce the exact reason for each specific failed request, but common troubleshooting steps include:

• Confirm you can open the target on a browser window (unless the target is rate limiting your IP address)
• Enable JavaScript rendering (as shown on this page)
• Change the geolocation (country) of the request
• Retry the request later (target websites may go down from time to time)

Enable JavaScript Rendering

If your target does not scrape, try sending the same request with JavaScript rendering enabled.

JavaScript, if scraping via API, see how to enable JavaScript rendering here .

If using the API playground on our dashboard, you can enable JavaScript rendering in the parameters window.