ERROR: Error downloading <GET https:// /robots.txt>: [<twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion: Connection lost.>] Traceback (most recent call last): code example

Example: twisted.python.failure.Failure twisted.internet.error.ConnectionLost: Connection to the other side was lost in a non-clean fashion.> scrapy

#if working with scrapy, and this 'twisted' issue occurs, try replacing
#"http:" with "https:" 
url = url.replace("http:", "https:")