check config file script?

[limey-bean]

At some point we should write a script to check that the user has what they need to run the scripts

[gauravsk]

@jessegomer is this something you could help with? often these pipeliens will have a setup.py that just checks if all the paths in the config resolve to the right thing