When Tensorflow is installed with GPU support using DYLD_LIBRARY_PATH to find the GPU libs guild train does not work while executing python directly works. The issue seems to be that guild doesn't set the same DYLD_LIBRARY_PATH.
ImportError: dlopen(/usr/local/lib/python2.7/site-packages/tensorflow/python/_pywrap_tensorflow.so, 10): Library not loaded: @rpath/libcudart.8.0.dylib
Referenced from: /usr/local/lib/python2.7/site-packages/tensorflow/python/_pywrap_tensorflow.so
Reason: image not found