scrawler

scrawler is a crawler4j fork and port over to Scala. It contains updated libraries, bug fixes (e.g., SSL support, redirect handling), and hopefully improvements.