How can I organize my spiders into nested directories in Scrapy?
I know this is long over due but this is the right way to organize your spiders in nested directories. You set the modules location in the settings defined here.
Example:
SPIDER_MODULES = ['my_project.spiders', 'my_project.spiders.subtopic1', 'my_project.spiders.subtopicx']