GitHub - Lightning-AI/LitServe: Build custom inference engines for models, agents, multi-modal systems, RAG, pipelines and more.

Build custom inference engines for models, agents, multi-modal systems, RAG, pipelines and more. - Lightning-AI/LitServe
github.com github.com