You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
[](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml)[](https://github.com/go-skynet/LocalAI/actions/workflows/release.yaml)[](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml)[](https://github.com/go-skynet/LocalAI/actions/workflows/bump_deps.yaml)[](https://artifacthub.io/packages/search?repo=localai)
50
49
51
-
**LocalAI** is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that’s compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by [Ettore Di Giacinto](https://github.com/mudler).
50
+
**LocalAI** is the free, Open Source OpenAI alternative. LocalAI act as a drop-in replacement REST API that's compatible with OpenAI (Elevenlabs, Anthropic... ) API specifications for local AI inferencing. It allows you to run LLMs, generate images, audio (and not only) locally or on-prem with consumer grade hardware, supporting multiple model families. Does not require GPU. It is created and maintained by [Ettore Di Giacinto](https://github.com/mudler).
51
+
52
+
53
+
## 📚🆕 Local Stack Family
54
+
55
+
🆕 LocalAI is now part of a comprehensive suite of AI tools designed to work together:
<p>A powerful Local AI agent management platform that serves as a drop-in replacement for OpenAI's Responses API, enhanced with advanced agentic capabilities.</p>
<p>A REST-ful API and knowledge base management system that provides persistent memory and storage capabilities for AI agents.</p>
78
+
</td>
79
+
</tr>
80
+
</table>
81
+
82
+
## Screenshots
83
+
52
84
53
85
| Talk Interface | Generate Audio |
54
86
| --- | --- |
55
-
|||
87
+
|||
56
88
57
89
| Models Overview | Generate Images |
58
90
| --- | --- |
59
-
|||
91
+
|||
60
92
61
-
| Chat Interface |API Overview|
93
+
| Chat Interface |Home|
62
94
| --- | --- |
63
-
|||
95
+
|||
64
96
65
97
| Login | Swarm |
66
98
| --- | --- |
67
-
|||
99
+
|||
68
100
69
-
## Quickstart
101
+
## 💻 Quickstart
70
102
71
103
Run the installer script:
72
104
@@ -108,10 +140,11 @@ local-ai run https://gist.githubusercontent.com/.../phi-2.yaml
For more information, see [💻 Getting started](https://localai.io/basics/getting_started/index.html)
112
144
113
145
## 📰 Latest project news
114
146
147
+
- Apr 2025: [LocalAGI](https://github.com/mudler/LocalAGI) and [LocalRecall](https://github.com/mudler/LocalRecall) join the LocalAI family stack.
115
148
- Apr 2025: WebUI overhaul, AIO images updates
116
149
- Feb 2025: Backend cleanup, Breaking changes, new backends (kokoro, OutelTTS, faster-whisper), Nvidia L4T images
117
150
- Jan 2025: LocalAI model release: https://huggingface.co/mudler/LocalAI-functioncall-phi-4-v0.3, SANA support in diffusers: https://github.com/mudler/LocalAI/pull/4603
@@ -127,19 +160,6 @@ local-ai run oci://localai/phi-2:latest
127
160
128
161
Roadmap items: [List of issues](https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3Aroadmap)
129
162
130
-
## 🔥🔥 Hot topics (looking for help):
131
-
132
-
- Multimodal with vLLM and Video understanding: https://github.com/mudler/LocalAI/pull/3729
133
-
- Realtime API https://github.com/mudler/LocalAI/issues/3714
If you want to help and contribute, issues up for grabs: https://github.com/mudler/LocalAI/issues?q=is%3Aissue+is%3Aopen+label%3A%22up+for+grabs%22
142
-
143
163
## 🚀 [Features](https://localai.io/features/)
144
164
145
165
- 📖 [Text generation with GPTs](https://localai.io/features/text-generation/) (`llama.cpp`, `transformers`, `vllm` ... [:book: and more](https://localai.io/model-compatibility/index.html#model-compatibility-table))
@@ -153,12 +173,10 @@ If you want to help and contribute, issues up for grabs: https://github.com/mudl
0 commit comments