mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-04-19 22:40:35 -04:00
Code Issues Packages Projects Releases Wiki Activity
4,530 Commits 88 Branches 143 Tags
599bc88c6c3cc941e1e481341d9f3731fd8905f0
Commit Graph

25 Commits

Author SHA1 Message Date
Ettore Di Giacinto
195aa22e77 chore(docs): update list of supported backends (#6134) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-08-24 20:09:19 +02:00
Dedy F. Setyawan
787302b204 fix(docs): Improve responsiveness of tables (#5954) 
Signed-off-by: Dedy F. Setyawan <dedyfajars@gmail.com>
 2025-08-01 22:13:53 +02:00
Ettore Di Giacinto
6644af10c6 feat: ⚠️ reduce images size and stop bundling sources (#5721) 
feat: reduce images size and stop bundling sources

Do not copy sources anymore, and reduce packages of the base images by
not using builder images.

If needed to rebuild, just build the container image from scratch by
following the docs. We will slowly try to migrate all backends to the
gallery to keep the core small.

This PR is a breaking change, it also sets the base folders to /models
and /backends instead of /build/models and /build/backends.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-06-26 18:41:38 +02:00
Ettore Di Giacinto
f3ae94ca70 chore: update Image generation docs and examples (#4841) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-02-17 16:51:06 +01:00
Ettore Di Giacinto
7f62b418a4 chore(docs): add documentation for l4t images 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-01-29 15:16:07 +01:00
Gianluca Boiano
032a33de49 chore: remove deprecated tinydream backend (#4631) 
Signed-off-by: Gianluca Boiano <morf3089@gmail.com>
 2025-01-18 18:35:30 +01:00
Ettore Di Giacinto
ab344e4f47 docs: update compatibility-table.md (#4557) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2025-01-07 21:20:44 +01:00
Ettore Di Giacinto
cab9f88ca4 chore(docs): add nvidia l4t instructions (#4454) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-12-23 18:59:33 +01:00
Ettore Di Giacinto
3127cd1352 chore(docs): update available backends (#4325) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-12-05 16:57:56 +01:00
Ettore Di Giacinto
9475a6fa05 chore: drop petals (#3316) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-08-20 10:01:38 +02:00
Ettore Di Giacinto
faadabea14 Update binaries.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-08-14 10:08:32 +02:00
Ettore Di Giacinto
9a7ad75bff docs: update to include installer and update advanced YAML options (#2631) 
* docs: update quickstart and advanced sections

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs: improvements

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* examples(kubernete): add nvidia example

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-22 12:00:38 +02:00
fakezeta
169d8d21ff gallery: Added some OpenVINO models (#2249) 
* Added some OpenVINO models

Added Phi-3 trust_remote_code: true
Added Hermes 2 Pro Llama3
Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU)
Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU)

* Added Remote Code for phi, fixed error on Yamllint

* update openvino.yaml

I need to go to rest: today is not my day...
 2024-05-06 10:52:05 +02:00
Ettore Di Giacinto
a24cd4fda0 docs: enhance and condense few sections (#2178) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-28 23:41:59 +02:00
Ettore Di Giacinto
5e243ceaeb docs: update gallery, add rerankers (#2166) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-28 15:54:15 +02:00
jtwolfe
729378ca98 AMD/ROCm Documentation update + formatting fix (#2100) 
* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

---------

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
 2024-04-22 15:47:51 +02:00
Ettore Di Giacinto
eab4a91a9b fix(aio): correctly detect intel systems (#1931) 
Also rename SIZE to PROFILE
 2024-03-30 12:04:32 +01:00
Ettore Di Giacinto
13ccd2afef docs(aio-usage): update docs to show examples (#1921) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-03-28 18:16:58 +01:00
Ettore Di Giacinto
e58410fa99 feat(aio): add intel profile (#1901) 
* feat(aio): add intel profile

* docs: clarify AIO images features
 2024-03-26 18:45:25 +01:00
Ettore Di Giacinto
c9adc5680c fix(aio): make image-gen for GPU functional, update docs (#1895) 
* readme: update quickstart

* aio(gpu): fix dreamshaper

* tests(aio): allow to run tests also against an endpoint

* docs: split content

* tests: less verbosity

---------

Co-authored-by: Dave <dave@gray101.com>
 2024-03-25 21:04:32 +00:00
Ettore Di Giacinto
98ad93d53e Drop ggml-based gpt2 and starcoder (supported by llama.cpp) (#1679) 
* Drop ggml-based gpt2 and starcoder (supported by llama.cpp)

* Update compatibility table
 2024-02-04 13:15:51 +01:00
Ettore Di Giacinto
df13ba655c Drop old falcon backend (deprecated) (#1675) 
Drop old falcon backend
 2024-02-03 13:01:13 +01:00
Ettore Di Giacinto
1c57f8d077 feat(sycl): Add support for Intel GPUs with sycl (#1647) (#1660) 
* feat(sycl): Add sycl support (#1647)

* onekit: install without prompts

* set cmake args only in grpc-server

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* cleanup

* fixup sycl source env

* Cleanup docs

* ci: runs on self-hosted

* fix typo

* bump llama.cpp

* llama.cpp: update server

* adapt to upstream changes

* adapt to upstream changes

* docs: add sycl

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-02-01 19:21:52 +01:00
Ettore Di Giacinto
ee42c9bfe6 docs: re-use original permalinks (#1610) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-01-19 19:23:58 +01:00
Ettore Di Giacinto
6ca4d38a01 docs/examples: enhancements (#1572) 
* docs: re-order sections

* fix references

* Add mixtral-instruct, tinyllama-chat, dolphin-2.5-mixtral-8x7b

* Fix link

* Minor corrections

* fix: models is a StringSlice, not a String

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* WIP: switch docs theme

* content

* Fix GH link

* enhancements

* enhancements

* Fixed how to link

Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>

* fixups

* logo fix

* more fixups

* final touches

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
Co-authored-by: lunamidori5 <118759930+lunamidori5@users.noreply.github.com>
 2024-01-18 19:41:08 +01:00