An integrated large-scale model training system with efficient parallelization techniques.
https://github.com/hpcaitech/ColossalAI
latest