DeepSpeed is a deep learning optimization library that makes distributed training easy, efficient, and effective.
https://github.com/microsoft/DeepSpeed
stable