MOSEC is a high-performance serving framework for ML models, offers dynamic batching and multi-stage pipeline …
https://github.com/mosecorg/mosec
latest