Introduction

​

Key features

• One request, every URL - get up to ~147,000 URLs in a single response.
• Synchronous - results come back in the same response, no polling.
• Sitemap + page links - URLs from the sitemap and the submitted page are merged into one list, with duplicates removed.
• Path filtering - include or exclude URLs with regex patterns.
• Domain scope - keep only the main domain, add subdomains, or include external links.
• Built-in anti-bot handling and geo targeting - map sites that block simple crawlers, as they appear from a specific country.

​

Pricing

​

Quick start

1. Sign up - activate the free plan or choose a paid plan from the dashboard.
2. Copy your API key from the dashboard.
3. Send a request with the URL you want to map.

​

Code example

#replace the TOKEN value with your API KEY
curl --request 'POST' \
        --url 'https://data.decodo.com/v1/map' \
        --header 'Accept: application/json' \
        --header 'Authorization: Bearer TOKEN VALUE' \
        --header 'Content-Type: application/json' \
        --data '
    {
    "url": "https://decodo.com"
    }
'