EMU version still cost GPU proceess

[liuyongbai]

Hi, I Test it on my env with both ori and emu version.I compiled and built the ori and emu versions on my two machines according to the instructions, but during the allreduce test, I found that the emu version still relies on the gpu device and does not seem to have the ability to "no GPU required" at present. Is that right? Will this capability continue to evolve in the future?

[livingshade]

Yes, we still need GPU on emu node for initialization even if no computation is done. Fully supporting "no GPU" would require hacking out all cuda/GPU related API in PyTorch.