System information
- AutoDist version:
- Are you willing to contribute it (Yes/No):
Describe the new feature and the current behavior/state
Will this change the current API? How?
Describe alternatives you've considered
Additional context
The current message encoding/decoding semantic is coupled with AllReduce synchronizer. We need to decouple it, and make it a standalone semantic (so to be more "composable").