Skip to main content

Get your API KEY

Copy your API key from the dashboard. Send it in the Authorization header as Bearer YOUR_API_KEY.

Start a crawl

Send a POST request with the URL you want to crawl. The response returns a crawl_id.
You will get a response that contains crawl_id and crawl status.
First response

Check the Crawl status

Use the crawl_status link from the response to see how far the crawl has progressed.

Get the results

Use results_content to get the scraped page content inline in the response, or results_tasks for a list of every crawled URL and its status.