LocalAI
- About
- Open-source AI engine with OpenAI-compatible APIs. Open-source alternative to OpenAI API.
- Catalogue
- No. 200
- Category
- AI
- GitHub stars
- ★ 0
Overview
LocalAI is an open-source AI engine that runs any model, including LLMs, vision, voice, image and video, on any hardware, with no GPU required. It offers drop-in compatible OpenAI, Anthropic and ElevenLabs APIs, so existing apps can switch to your own infrastructure.
What it does well
LocalAI wraps engines such as llama.cpp, vLLM, whisper.cpp and stable-diffusion as separate backends, pulled only when a model needs them. It runs on NVIDIA, AMD, Intel, Apple Silicon, Vulkan or CPU only, and includes API keys, user quotas, role-based access and built-in agents with tools, RAG and MCP.
Why it’s in the collection
LocalAI is the simplest way to point apps built for the OpenAI API at models you host yourself. It is MIT-licensed.
On GitHub
- Stars
- 0
- Forks
- 0
- Commits
- 0
- Repository
- mudler/LocalAI
Languages
- Go 67.3%
- JavaScript 14.9%
- C++ 4.5%
- Python 4.3%
- Other 9%
OpenAI API
Anthropic API
Ollama
