GitHub - InternLM/lmdeploy: LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

LMDeploy is a toolkit for compressing, deploying, and serving LLMs. - InternLM/lmdeploy
github.com github.com