A way to know when all scraper requests have completed for the entire process?

[jfrux]

Please advise if I'm just a n00b and it's really obvious...

[nickewansmith]

You could program this yourself, I ended up creating my own queue using the logic from this scraper. After lots of debugging I now have a completely different version in which I can detect when my queue is done if I wanted.