Scrapy Proxy Middleware

1. Open the Terminal window.
2. Navigate to the main directory of your project folder using cd yourprojectname.
3. Download our proxy middleware using the following command:

curl https://raw.githubusercontent.com/Smartproxy/Scrapy-Middleware/master/smartproxy_auth.py > smartproxy_auth.py

4. You should now see that your project folder contains the decodo_auth.py file.
5. Using a file manager, navigate to your project folder, where you should see the settings.py file.
6. Edit the settings.py file using an editor of your choice.
7. Add the following properties at the bottom:

DOWNLOADER_MIDDLEWARES = {
    'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware': 110,
    'yourprojectname.decodo_auth.ProxyMiddleware': 100,
}

DECODO_USER = 'username' ## Decodo Username (Sub-user)
DECODO_PASSWORD = 'password' ## Password for your user
DECODO_ENDPOINT = 'gate.decodo.com' ## Endpoint you'd like to use
DECODO_PORT = '7000' ## Port of the endpoint you are using.

8. In the DOWNLOADER_MIDDLEWARES section, change the yourprojectname line to the name of your project.

9. Make sure that you enter your account details as well as proxy details within quotation marks ' '.
10. Finally, Save the file.

📘

To find more information about the setup, make sure to visit our Github Page. In case you wish to use Decodo directly in your request, please refer to this article.