Distributed Crawler Management Framework Based on Scrapy, Scrapyd.
https://github.com/Gerapy/Gerapy.git
master