mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-01-22 05:11:21 -05:00
Code Issues Packages Projects Releases Wiki Activity
3,875 Commits 75 Branches 134 Tags
dc7c51dcc72bafa2a6cc63dfb93196fd66d4a93a
Commit Graph

55 Commits

Author SHA1 Message Date
Ettore Di Giacinto
61cc76c455 chore(autogptq): drop archived backend (#5214) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-04-19 15:52:29 +02:00
Ettore Di Giacinto
4f239bac89 feat: rebrand - LocalAGI and LocalRecall joins the LocalAI stack family (#5159) 
* wip

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update lotusdocs and hugo

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* rephrasing

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Latest fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Adjust readme section

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-04-15 17:51:24 +02:00
Ettore Di Giacinto
f3ae94ca70 chore: update Image generation docs and examples (#4841) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-02-17 16:51:06 +01:00
Ettore Di Giacinto
7f90ff7aec chore(llama-ggml): drop deprecated backend (#4775) 
The GGML format is now dead, since in the next version of LocalAI we
already bring many breaking compatibility changes, taking the occasion
also to drop ggml support (pre-gguf).

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-02-06 18:36:23 +01:00
Ettore Di Giacinto
af41436f1b fix(tests): pin to branch for config used in tests (#4721) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2025-01-31 09:57:58 +01:00
jtwolfe
ae9855a39e chore(docs): patch p2p detail in env and docs (#4434) 
* Update distributed_inferencing.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update .env

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update distributed_inferencing.md

whoops

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

---------

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-12-19 15:19:31 +01:00
Ettore Di Giacinto
44a5dac312 feat(backend): add stablediffusion-ggml (#4289) 
* feat(backend): add stablediffusion-ggml

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(ci): track stablediffusion-ggml

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Use default scheduler and sampler if not specified

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fixups

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Move cfg scale out of diffusers block

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Make it working

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* fix: set free_params_immediately to false to call the model in sequence

https://github.com/leejet/stable-diffusion.cpp/issues/366

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-12-03 22:41:22 +01:00
Ettore Di Giacinto
3c3050f68e feat(backends): Drop bert.cpp (#4272) 
* feat(backends): Drop bert.cpp

use llama.cpp 3.2 as a drop-in replacement for bert.cpp

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* chore(tests): make test more robust

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-11-27 16:34:28 +01:00
mintyleaf
9892d7d584 feat(p2p): add support for configuration of edgevpn listen_maddrs, dht_announce_maddrs and bootstrap_peers (#4200) 
* add support for edgevpn listen_maddrs, dht_announce_maddrs, dht_bootstrap_peers

* upd docs for libp2p loglevel
 2024-11-20 14:18:52 +01:00
Arnaud A
0b3a55b9fe docs: Update documentation for text-to-audio feature regarding response_format (#4038) 2024-11-03 02:15:54 +00:00
Ettore Di Giacinto
11d960b2a6 chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both (#3428) 
* chore(cli): be consistent between workers and expose ExtraLLamaCPPArgs to both

Fixes: https://github.com/mudler/LocalAI/issues/3427

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* bump grpcio

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-08-30 00:10:17 +02:00
Ettore Di Giacinto
0762aa5327 Update GPU-acceleration.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-08-24 09:58:49 +02:00
Ettore Di Giacinto
d3a217c254 chore(docs): update p2p env var documentation (#3350) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-08-21 13:09:57 +02:00
四少爷
2a3427e533 fix(docs): Refer to the OpenAI documentation to update the openai-functions docu… (#3317) 
* Refer to the OpenAI documentation to update the openai-functions documentation

I saw the openai official website, apIn the description: The parameters `function_call` and `functions` have been replaced by `tool_choice` and `tools`.So I submitted this update;But I haven't read the code of localai, so I'm not sure if it also applies to localai.

Signed-off-by: 四少爷 <sex@jermey.cn>

* Update Usage Example

The original usage example was too outdated, and calling with the new version of the openai python package would result in errors. Therefore, the curl example was rewritten (as curl examples are also used elsewhere).

Signed-off-by: 四少爷 <sex@jermey.cn>

* add python example

Signed-off-by: 四少爷 <sex@jermey.cn>

---------

Signed-off-by: 四少爷 <sex@jermey.cn>
 2024-08-21 13:09:26 +02:00
Ettore Di Giacinto
9475a6fa05 chore: drop petals (#3316) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-08-20 10:01:38 +02:00
Ettore Di Giacinto
89484efaed docs: update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-24 12:27:49 +02:00
Ettore Di Giacinto
153e977155 Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-07-22 17:35:10 +02:00
Ettore Di Giacinto
87bd831aba docs: add federation (#2929) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-20 10:43:18 +02:00
Ettore Di Giacinto
d5a56f04be feat(p2p): allow to disable DHT and use only LAN (#2751) 
This allows LocalAI to be less noisy avoiding to connect outside.
Needed if e.g. there is no plan into using p2p across separate networks.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-07-09 23:10:02 +02:00
Ettore Di Giacinto
515d98b978 Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:49 +02:00
Ettore Di Giacinto
789cf6c599 Update model-gallery.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 12:10:27 +02:00
Ettore Di Giacinto
070fd1b9da Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:06:09 +02:00
Ettore Di Giacinto
dda5b9f260 Update distributed_inferencing.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-22 10:05:48 +02:00
Ettore Di Giacinto
148adebe16 docs: fix p2p commands (#2472) 
Also change icons on GPT vision page

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-06-03 16:58:53 +02:00
Chakib Benziane
b99182c8d4 TTS API improvements (#2308) 
* update doc on COQUI_LANGUAGE env variable

Signed-off-by: blob42 <contact@blob42.xyz>

* return errors from tts gRPC backend

Signed-off-by: blob42 <contact@blob42.xyz>

* handle speaker_id and language in coqui TTS backend

Signed-off-by: blob42 <contact@blob42.xyz>

* TTS endpoint: add optional language paramter

Signed-off-by: blob42 <contact@blob42.xyz>

* tts fix: empty language string breaks non-multilingual models

Signed-off-by: blob42 <contact@blob42.xyz>

* allow tts param definition in config file

- consolidate TTS options under `tts` config entry

Signed-off-by: blob42 <contact@blob42.xyz>

* tts: update doc

Signed-off-by: blob42 <contact@blob42.xyz>

---------

Signed-off-by: blob42 <contact@blob42.xyz>
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-06-01 18:26:27 +00:00
Ettore Di Giacinto
5d31e5269d feat(functions): allow response_regex to be a list (#2447) 
feat(functions): allow regex match to be a list

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-31 22:52:02 +02:00
Ettore Di Giacinto
b90cdced59 docs: rewording 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 20:18:25 +02:00
Ettore Di Giacinto
fc3502b56f docs: rewording 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 20:17:04 +02:00
Ettore Di Giacinto
785adc1ed5 docs: updaet title 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 16:13:48 +02:00
Ettore Di Giacinto
bb3ec56de3 docs: add distributed inferencing docs 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-25 16:12:08 +02:00
Ettore Di Giacinto
cf513efa78 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:09:51 +02:00
Ettore Di Giacinto
9e8b34427a Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:05:16 +02:00
Ettore Di Giacinto
88d0aa1e40 docs: update function docs 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:03:56 +02:00
fakezeta
fa10302dd2 docs: updated Transformer parameters description (#2234) 
updated Transformer parameters
 2024-05-04 10:45:25 +02:00
Ettore Di Giacinto
5e243ceaeb docs: update gallery, add rerankers (#2166) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-28 15:54:15 +02:00
QuinnPiers
1a0a6f60a7 docs: update model-gallery.md with correct gallery file (#2163) 
* Update model-gallery.md with correct gallery file

The readme points to a file that hasn't been updated in months so when there are announcements about new models, user's won't get them pointing to the old file. Point to the updated files instead.

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

second pass with more understanding

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

* Update model-gallery.md

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>

---------

Signed-off-by: QuinnPiers <167640194+QuinnPiers@users.noreply.github.com>
 2024-04-28 12:34:15 +02:00
Taikono-Himazin
b6f0e80d54 Update text-generation.md (#2095) 
Signed-off-by: Taikono-Himazin <kazu@po.harenet.ne.jp>
 2024-04-22 16:37:13 +02:00
jtwolfe
729378ca98 AMD/ROCm Documentation update + formatting fix (#2100) 
* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update aio-images.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

* Update GPU-acceleration.md

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>

---------

Signed-off-by: jtwolfe <jamie.t.wolfe@gmail.com>
 2024-04-22 15:47:51 +02:00
Ettore Di Giacinto
b2785ff06e feat(gallery): support ConfigURLs (#2012) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-12 00:49:23 +02:00
Ettore Di Giacinto
92005b9c02 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:30:57 +02:00
Ettore Di Giacinto
636d487dc8 Update gpt-vision.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:30:03 +02:00
Ettore Di Giacinto
93f51d80d4 Update gpt-vision.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-04-10 16:29:46 +02:00
Ettore Di Giacinto
ff77d3bc22 fix(seed): generate random seed per-request if -1 is set (#1952) 
* fix(seed): generate random seed per-request if -1 is set

Also update ci with new workflows and allow the aio tests to run with an
api key

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* docs(openvino): Add OpenVINO example

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-04-03 22:25:47 +02:00
Richard Palethorpe
643d85d2cc feat(stores): Vector store backend (#1795) 
Add simple vector store backend

Signed-off-by: Richard Palethorpe <io@richiejp.com>
 2024-03-22 21:14:04 +01:00
Ettore Di Giacinto
ae2e4fc2fe docs(transformers): add docs section about transformers (#1841) 2024-03-15 18:13:30 +01:00
Ettore Di Giacinto
20136ca8b7 feat(tts): add Elevenlabs and OpenAI TTS compatibility layer (#1834) 
* feat(elevenlabs): map elevenlabs API support to TTS

This allows elevenlabs Clients to work automatically with LocalAI by
supporting the elevenlabs API.

The elevenlabs server endpoint is implemented such as it is wired to the
TTS endpoints.

Fixes: https://github.com/mudler/LocalAI/issues/1809

* feat(openai/tts): compat layer with openai tts

Fixes: #1276

* fix: adapt tts CLI
 2024-03-14 23:08:34 +01:00
Ludovic Leroux
939411300a Bump vLLM version + more options when loading models in vLLM (#1782) 
* Bump vLLM version to 0.3.2

* Add vLLM model loading options

* Remove transformers-exllama

* Fix install exllama
 2024-03-01 22:48:53 +01:00
Ettore Di Giacinto
be498c5dd9 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-28 15:58:31 +01:00
Ettore Di Giacinto
c8be839481 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-02-27 23:24:46 +01:00
Ettore Di Giacinto
fd68bf7084 fix(vall-e-x): Fix voice cloning (#1696) 2024-02-11 11:20:00 +01:00