scrapy proxy pool code example

Example 1: scrapy proxy pool

# Add this lines into settings.py file
PROXY_POOL_ENABLED = True
DOWNLOADER_MIDDLEWARES = {
    'scrapy_proxy_pool.middlewares.ProxyPoolMiddleware': 610,
    'scrapy_proxy_pool.middlewares.BanDetectionMiddleware': 620,
}

Example 2: scrapy proxy pool

PROXY_POOL_ENABLED = True

Example 3: scrapy proxy pool

DOWNLOADER_MIDDLEWARES = {
    # ...
    'scrapy_proxy_pool.middlewares.ProxyPoolMiddleware': 610,
    'scrapy_proxy_pool.middlewares.BanDetectionMiddleware': 620,
    # ...
}

Example 4: scrapy proxy pool

pip install scrapy_proxy_pool

Example 5: scrapy proxy pool

pip install scrapy-proxy-pool

Example 6: scrapy proxy pool

pip install scrapy-proxy-pool