scrapy proxi pool code example
Example 1: scrapy proxy pool
# Add this lines into settings.py file
PROXY_POOL_ENABLED = True
DOWNLOADER_MIDDLEWARES = {
'scrapy_proxy_pool.middlewares.ProxyPoolMiddleware': 610,
'scrapy_proxy_pool.middlewares.BanDetectionMiddleware': 620,
}
Example 2: scrapy proxy pool
pip install scrapy_proxy_pool