mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-11-05 20:13:23 -05:00
Code Issues Packages Projects Releases Wiki Activity
3,875 Commits 397 Branches 181 Tags
dc7c51dcc72bafa2a6cc63dfb93196fd66d4a93a
Commit Graph
55 Commits
Author SHA1 Message Date
Ettore Di Giacinto 61cc76c455 chore(autogptq): drop archived backend (#5214) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-04-19 15:52:29 +02:00
Ettore Di Giacinto 4f239bac89 feat: rebrand - LocalAGI and LocalRecall joins the LocalAI stack family (#5159) 
* wip

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update lotusdocs and hugo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* rephrasing

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Latest fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Adjust readme section

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-04-15 17:51:24 +02:00
Ettore Di Giacinto f3ae94ca70 chore: update Image generation docs and examples (#4841) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-02-17 16:51:06 +01:00
Ettore Di Giacinto 7f90ff7aec chore(llama-ggml): drop deprecated backend (#4775) 
The GGML format is now dead, since in the next version of LocalAI we
already bring many breaking compatibility changes, taking the occasion
also to drop ggml support (pre-gguf).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-02-06 18:36:23 +01:00
Ettore Di Giacinto af41436f1b fix(tests): pin to branch for config used in tests (#4721) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-01-31 09:57:58 +01:00
jtwolfeandEttore Di Giacinto ae9855a39e chore(docs): patch p2p detail in env and docs (#4434) 
* Update distributed_inferencing.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update .env

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update distributed_inferencing.md

whoops

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

---------

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-12-19 15:19:31 +01:00
Ettore Di Giacinto 44a5dac312 feat(backend): add stablediffusion-ggml (#4289) 
* feat(backend): add stablediffusion-ggml

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(ci): track stablediffusion-ggml

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Use default scheduler and sampler if not specified

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Move cfg scale out of diffusers block

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make it working

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: set free_params_immediately to false to call the model in sequence

https://github.com/leejet/stable-diffusion.cpp/issues/366

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-12-03 22:41:22 +01:00
Ettore Di Giacinto 3c3050f68e feat(backends): Drop bert.cpp (#4272) 
* feat(backends): Drop bert.cpp

use llama.cpp 3.2 as a drop-in replacement for bert.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(tests): make test more robust

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-11-27 16:34:28 +01:00
mintyleaf 9892d7d584 feat(p2p): add support for configuration of edgevpn listen_maddrs, dht_announce_maddrs and bootstrap_peers (#4200) 
* add support for edgevpn listen_maddrs, dht_announce_maddrs, dht_bootstrap_peers

* upd docs for libp2p loglevel
 2024-11-20 14:18:52 +01:00
Arnaud A 0b3a55b9fe docs: Update documentation for text-to-audio feature regarding response_format (#4038) 2024-11-03 02:15:54 +00:00
Ettore Di Giacinto 11d960b2a6 chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both (#3428) 
* chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both

Fixes: https://github.com/mudler/LocalAI/issues/3427

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* bump grpcio

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-08-30 00:10:17 +02:00
Ettore Di Giacinto 0762aa5327 Update GPU-acceleration.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-08-24 09:58:49 +02:00
Ettore Di Giacinto d3a217c254 chore(docs): update p2p env var documentation (#3350) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-08-21 13:09:57 +02:00
四少爷 2a3427e533 fix(docs): Refer to the OpenAI documentation to update the openai-functions docu… (#3317) 
* Refer to the OpenAI documentation to update the openai-functions documentation

I saw the openai official website, apIn the description: The parameters `function_call` and `functions` have been replaced by `tool_choice` and `tools`.So I submitted this update;But I haven't read the code of localai, so I'm not sure if it also applies to localai.

Signed-off-by: 四少爷 <sex@jermey.cn>

* Update Usage Example

The original usage example was too outdated, and calling with the new version of the openai python package would result in errors. Therefore, the curl example was rewritten (as curl examples are also used elsewhere).

Signed-off-by: 四少爷 <sex@jermey.cn>

* add python example

Signed-off-by: 四少爷 <sex@jermey.cn>

---------

Signed-off-by: 四少爷 <sex@jermey.cn>
 2024-08-21 13:09:26 +02:00
Ettore Di Giacinto 9475a6fa05 chore: drop petals (#3316) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-08-20 10:01:38 +02:00
Ettore Di Giacinto 89484efaed docs: update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-24 12:27:49 +02:00
Ettore Di Giacinto 153e977155 Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-22 17:35:10 +02:00
Ettore Di Giacinto 87bd831aba docs: add federation (#2929) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:18 +02:00
Ettore Di Giacinto d5a56f04be feat(p2p): allow to disable DHT and use only LAN (#2751) 
This allows LocalAI to be less noisy avoiding to connect outside.
Needed if e.g. there is no plan into using p2p across separate networks.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 23:10:02 +02:00
Ettore Di Giacinto 515d98b978 Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:49 +02:00
Ettore Di Giacinto 789cf6c599 Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:27 +02:00
Ettore Di Giacinto 070fd1b9da Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:06:09 +02:00
Ettore Di Giacinto dda5b9f260 Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:05:48 +02:00
Ettore Di Giacinto 148adebe16 docs: fix p2p commands (#2472) 
Also change icons on GPT vision page

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 16:58:53 +02:00
Chakib BenzianeandEttore Di Giacinto b99182c8d4 TTS API improvements (#2308) 
* update doc on COQUI_LANGUAGE env variable

Signed-off-by: blob42 <contact@blob42.xyz>

* return errors from tts gRPC backend

Signed-off-by: blob42 <contact@blob42.xyz>

* handle speaker_id and language in coqui TTS backend

Signed-off-by: blob42 <contact@blob42.xyz>

* TTS endpoint: add optional language paramter

Signed-off-by: blob42 <contact@blob42.xyz>

* tts fix: empty language string breaks non-multilingual models

Signed-off-by: blob42 <contact@blob42.xyz>

* allow tts param definition in config file

- consolidate TTS options under `tts` config entry

Signed-off-by: blob42 <contact@blob42.xyz>

* tts: update doc

Signed-off-by: blob42 <contact@blob42.xyz>

---------

Signed-off-by: blob42 <contact@blob42.xyz>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-01 18:26:27 +00:00
Ettore Di Giacinto 5d31e5269d feat(functions): allow response_regex to be a list (#2447) 
feat(functions): allow regex match to be a list

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 22:52:02 +02:00
Ettore Di Giacinto b90cdced59 docs: rewording 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 20:18:25 +02:00
Ettore Di Giacinto fc3502b56f docs: rewording 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 20:17:04 +02:00
Ettore Di Giacinto 785adc1ed5 docs: updaet title 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 16:13:48 +02:00
Ettore Di Giacinto bb3ec56de3 docs: add distributed inferencing docs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 16:12:08 +02:00
Ettore Di Giacinto cf513efa78 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:09:51 +02:00
Ettore Di Giacinto 9e8b34427a Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:05:16 +02:00
Ettore Di Giacinto 88d0aa1e40 docs: update function docs 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:03:56 +02:00
fakezeta fa10302dd2 docs: updated Transformer parameters description (#2234) 
updated Transformer parameters
 2024-05-04 10:45:25 +02:00
Ettore Di Giacinto 5e243ceaeb docs: update gallery, add rerankers (#2166) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-28 15:54:15 +02:00
QuinnPiers 1a0a6f60a7 docs: update model-gallery.md with correct gallery file (#2163) 
* Update model-gallery.md with correct gallery file

The readme points to a file that hasn't been updated in months so when there are announcements about new models, user's won't get them pointing to the old file. Point to the updated files instead.

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

second pass with more understanding

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

---------

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>
 2024-04-28 12:34:15 +02:00
Taikono-Himazin b6f0e80d54 Update text-generation.md (#2095) 
Signed-off-by: Taikono-Himazin <kazu@po.harenet.ne.jp>
 2024-04-22 16:37:13 +02:00
jtwolfe 729378ca98 AMD/ROCm Documentation update + formatting fix (#2100) 
* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

---------

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
 2024-04-22 15:47:51 +02:00
Ettore Di Giacinto b2785ff06e feat(gallery): support ConfigURLs (#2012) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-12 00:49:23 +02:00
Ettore Di Giacinto 92005b9c02 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:30:57 +02:00
Ettore Di Giacinto 636d487dc8 Update gpt-vision.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:30:03 +02:00
Ettore Di Giacinto 93f51d80d4 Update gpt-vision.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:29:46 +02:00
Ettore Di Giacinto ff77d3bc22 fix(seed): generate random seed per-request if -1 is set (#1952) 
* fix(seed): generate random seed per-request if -1 is set

Also update ci with new workflows and allow the aio tests to run with an
api key

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs(openvino): Add OpenVINO example

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-03 22:25:47 +02:00
Richard Palethorpe 643d85d2cc feat(stores): Vector store backend (#1795) 
Add simple vector store backend

Signed-off-by: Richard Palethorpe <io@richiejp.com>
 2024-03-22 21:14:04 +01:00
Ettore Di Giacinto ae2e4fc2fe docs(transformers): add docs section about transformers (#1841) 2024-03-15 18:13:30 +01:00
Ettore Di Giacinto 20136ca8b7 feat(tts): add Elevenlabs and OpenAI TTS compatibility layer (#1834) 
* feat(elevenlabs): map elevenlabs API support to TTS

This allows elevenlabs Clients to work automatically with LocalAI by
supporting the elevenlabs API.

The elevenlabs server endpoint is implemented such as it is wired to the
TTS endpoints.

Fixes: https://github.com/mudler/LocalAI/issues/1809

* feat(openai/tts): compat layer with openai tts

Fixes: #1276

* fix: adapt tts CLI
 2024-03-14 23:08:34 +01:00
Ludovic Leroux 939411300a Bump vLLM version + more options when loading models in vLLM (#1782) 
* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama
 2024-03-01 22:48:53 +01:00
Ettore Di Giacinto be498c5dd9 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-28 15:58:31 +01:00
Ettore Di Giacinto c8be839481 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-27 23:24:46 +01:00
Ettore Di Giacinto fd68bf7084 fix(vall-e-x): Fix voice cloning (#1696) 2024-02-11 11:20:00 +01:00