Markdown
Site Unblocker supports automatically transforming HTML output into Markdown. This is useful if you plan on feeding scraping results into large language models, which usually have a limited token context.
Transforming to Markdown is only available in the Web Advanced and Site Unblocker plans.
Example using Site Unblocker:
curl -k -x https://unblock.decodo.com:60000 'https://www.example.com/' \
-H 'X-SU-Markdown: 1' \
-U 'your_username:your_password'
Example output:
# Example Domain
This domain is for use in illustrative examples in documents. You may use this domain in literature without prior coordination or asking for permission.
[More information...](https://www.iana.org/domains/example)
Updated about 22 hours ago