Question about Multi-Machine Topology

[ConnollyLeon]

msccl-tools can get local topology by parsing the nvidia-smi topo -m information. How do you get topology of multi-machines? Does msccl-tools support it now?

Could you please offer me some help?

[saeedmaleki]

For multi-node topology, we have found nvidia-smi topo -m not to be most helpful. Instead please use lstopo from hwloc package which gives a much more detailed NUMA node topology. We don't currently automatically parse the output of lstopo

For multi-node synthesis, please use TACCL. If you wish to write a manual algorithm, you may follow one of the many examples in here. You almost certainly will run into scalability issues with SCCL. TACCL is the proper solver for multi-node.