|
|
|
@@ -5,8 +5,6 @@
|
|
|
|
|
<br>
|
|
|
|
|
</h1>
|
|
|
|
|
|
|
|
|
|
> :warning: This project has been renamed from `llama-cli` to `LocalAI` to reflect the fact that we are focusing on a fast drop-in OpenAI API rather than on the CLI interface. We think that there are already many projects that can be used as a CLI interface already, for instance [llama.cpp](https://github.com/ggerganov/llama.cpp) and [gpt4all](https://github.com/nomic-ai/gpt4all). If you are using `llama-cli` for CLI interactions and want to keep using it, use older versions or please open up an issue - contributions are welcome!
|
|
|
|
|
|
|
|
|
|
[](https://github.com/go-skynet/LocalAI/actions/workflows/test.yml) [](https://github.com/go-skynet/LocalAI/actions/workflows/image.yml)
|
|
|
|
|
|
|
|
|
|
[](https://discord.gg/uJAeKSAGDy)
|
|
|
|
@@ -19,10 +17,17 @@
|
|
|
|
|
- Support for prompt templates
|
|
|
|
|
- Doesn't shell-out, but uses C bindings for a faster inference and better performance. Uses [go-llama.cpp](https://github.com/go-skynet/go-llama.cpp) and [go-gpt4all-j.cpp](https://github.com/go-skynet/go-gpt4all-j.cpp).
|
|
|
|
|
|
|
|
|
|
Reddit post: https://www.reddit.com/r/selfhosted/comments/12w4p2f/localai_openai_compatible_api_to_run_llm_models/
|
|
|
|
|
|
|
|
|
|
LocalAI is a community-driven project, focused on making the AI accessible to anyone. Any contribution, feedback and PR is welcome! It was initially created by [mudler](https://github.com/mudler/) at the [SpectroCloud OSS Office](https://github.com/spectrocloud).
|
|
|
|
|
|
|
|
|
|
### Socials and community chatter
|
|
|
|
|
- Follow [@LocalAI_API](https://twitter.com/LocalAI_API) on twitter.
|
|
|
|
|
|
|
|
|
|
- [Reddit post](https://www.reddit.com/r/selfhosted/comments/12w4p2f/localai_openai_compatible_api_to_run_llm_models/) about LocalAI.
|
|
|
|
|
|
|
|
|
|
- [Hacker news post](https://news.ycombinator.com/item?id=35726934) - help us out by voting if you like this project.
|
|
|
|
|
|
|
|
|
|
- [Tutorial to use k8sgpt with LocalAI](https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65) - excellent usecase for localAI, using AI to analyse Kubernetes clusters.
|
|
|
|
|
|
|
|
|
|
## Model compatibility
|
|
|
|
|
|
|
|
|
|
It is compatible with the models supported by [llama.cpp](https://github.com/ggerganov/llama.cpp) supports also [GPT4ALL-J](https://github.com/nomic-ai/gpt4all) and [cerebras-GPT with ggml](https://huggingface.co/lxe/Cerebras-GPT-2.7B-Alpaca-SP-ggml).
|
|
|
|
@@ -336,9 +341,10 @@ See also [chatbot-ui](https://github.com/go-skynet/LocalAI/tree/master/examples/
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
## Blog posts
|
|
|
|
|
## Blog posts and other articles
|
|
|
|
|
|
|
|
|
|
- https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65
|
|
|
|
|
- https://kairos.io/docs/examples/localai/
|
|
|
|
|
|
|
|
|
|
## Windows compatibility
|
|
|
|
|
|
|
|
|
@@ -424,6 +430,11 @@ Feel free to open up a PR to get your project listed!
|
|
|
|
|
- [Kairos](https://github.com/kairos-io/kairos)
|
|
|
|
|
- [k8sgpt](https://github.com/k8sgpt-ai/k8sgpt#running-local-models)
|
|
|
|
|
|
|
|
|
|
## Blog posts and other articles on LocalAI
|
|
|
|
|
|
|
|
|
|
- https://medium.com/@tyler_97636/k8sgpt-localai-unlock-kubernetes-superpowers-for-free-584790de9b65
|
|
|
|
|
- https://kairos.io/docs/examples/localai/
|
|
|
|
|
|
|
|
|
|
## Short-term roadmap
|
|
|
|
|
|
|
|
|
|
- [x] Mimic OpenAI API (https://github.com/go-skynet/LocalAI/issues/10)
|
|
|
|
@@ -432,7 +443,7 @@ Feel free to open up a PR to get your project listed!
|
|
|
|
|
- [x] Multi-model support
|
|
|
|
|
- [x] Have a webUI!
|
|
|
|
|
- [x] Allow configuration of defaults for models.
|
|
|
|
|
- [ ] Enable automatic downloading of models from a curated gallery, with only free-licensed models.
|
|
|
|
|
- [ ] Enable automatic downloading of models from a curated gallery, with only free-licensed models, directly from the webui.
|
|
|
|
|
|
|
|
|
|
## Star history
|
|
|
|
|
|
|
|
|
@@ -450,3 +461,9 @@ MIT
|
|
|
|
|
- https://github.com/tatsu-lab/stanford_alpaca
|
|
|
|
|
- https://github.com/cornelk/llama-go for the initial ideas
|
|
|
|
|
- https://github.com/antimatter15/alpaca.cpp for the light model version (this is compatible and tested only with that checkpoint model!)
|
|
|
|
|
|
|
|
|
|
## Contributors
|
|
|
|
|
|
|
|
|
|
<a href="https://github.com/go-skynet/LocalAI/graphs/contributors">
|
|
|
|
|
<img src="https://contrib.rocks/image?repo=go-skynet/LocalAI" />
|
|
|
|
|
</a>
|
|
|
|
|
