Site Unblocker supports automatically transforming HTML output into Markdown. This is useful if you plan on feeding scraping results into large language models, which usually have a limited token context.
Transforming to Markdown is only available in the Web Advanced and Site Unblocker plans.
Example using Site Unblocker:
curl -k -x https://unblock.decodo.com:60000 'https://www.example.com/' \
-H 'X-SU-Markdown: 1' \
-U 'your_username:your_password'
Example output:
# Example Domain
This domain is for use in illustrative examples in documents. You may use this domain in literature without prior coordination or asking for permission.
[More information...](https://www.iana.org/domains/example)
Support
Need help or just want to say hello? Our support is available 24/7.
You can also reach us anytime via email at support@decodo.com. Feedback
Can’t find what you’re looking for? Request an article!
Have feedback? Share your thoughts on how we can improve.