BarkingOwl is a scalable web crawler intended to be used to find specific document types …
https://github.com/thequbit/BarkingOwl
stable