LocalAI

The free, OpenAI and Anthropic alternative. A small, composable AI stack: run any model locally and install only what you use.