mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-10-11 08:15:12 -04:00
Code Issues Packages Projects Releases Wiki Activity
1,635 Commits 323 Branches 179 Tags
88942e4761fd799a825ff0a27a3f4c85957879e9
Commit Graph
1635 Commits
This Branch
This Branch
All Branches
Author SHA1 Message Date
cryptk 88942e4761 fix: add missing openvino/optimum/etc libraries for Intel, fixes #2289 (#2292) 
Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
 2024-05-12 09:01:45 +02:00
Ettore Di Giacinto efa32a2677 feat(grammar): support models with specific construct (#2291) 
When enabling grammar with functions, it might be useful to
allow more flexibility to support models that are fine-tuned against returning
function calls of the form of { "name": "function_name", "arguments" {...} }
rather then { "function": "function_name", "arguments": {..} }.

This might call out to a more generic approach later on, but for the moment being we can easily support both
as we have just to specific different types.

If needed we can expand on this later on

Signed-off-by: mudler <mudler@localai.io>
 2024-05-12 01:13:22 +02:00
LocalAI [bot]andmudler dfc420706c ⬆️ Update ggerganov/llama.cpp (#2290) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-11 21:16:34 +00:00
cryptk e2de8a88f7 feat: create bash library to handle install/run/test of python backends (#2286) 
* feat: create bash library to handle install/run/test of python backends

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* chore: minor cleanup

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: remove incorrect LIMIT_TARGETS from parler-tts

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: update runUnitests to handle running tests from a custom test file

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* chore: document runUnittests

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

---------

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
 2024-05-11 18:32:46 +02:00
Ettore Di Giacinto 7f4febd6c2 models(gallery): add Llama-3-8B-Instruct-abliterated (#2288) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-11 10:10:57 +02:00
LocalAI [bot]andmudler 93e581dfd0 ⬆️ Update ggerganov/llama.cpp (#2285) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-10 21:09:22 +00:00
Ettore Di Giacinto cf513efa78 Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:09:51 +02:00
Ettore Di Giacinto 9e8b34427a Update openai-functions.md 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:05:16 +02:00
Ettore Di Giacinto 88d0aa1e40 docs: update function docs 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-10 17:03:56 +02:00
Ettore Di Giacinto 9b09eb005f build: do not specify a BUILD_ID by default (#2284) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-10 16:01:55 +02:00
Ettore Di Giacinto 4db41b71f3 models(gallery): add aloe (#2283) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-10 16:01:47 +02:00
cryptk 28a421cb1d feat: migrate python backends from conda to uv (#2215) 
* feat: migrate diffusers backend from conda to uv

  - replace conda with UV for diffusers install (prototype for all
    extras backends)
  - add ability to build docker with one/some/all extras backends
    instead of all or nothing

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate autogtpq bark coqui from conda to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: convert exllama over to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate exllama2 to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate mamba to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate parler to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate petals to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: fix tests

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate rerankers to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate sentencetransformers to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: install uv for tests-linux

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: make sure file exists before installing on intel images

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate transformers backend to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate transformers-musicgen to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate vall-e-x to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: migrate vllm to uv

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: add uv install to the rest of test-extra.yml

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: adjust file perms on all install/run/test scripts

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: add missing acclerate dependencies

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: add some more missing dependencies to python backends

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: parler tests venv py dir fix

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: correct filename for transformers-musicgen tests

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: adjust the pwd for valle tests

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: cleanup and optimization work for uv migration

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: add setuptools to requirements-install for mamba

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: more size optimization work

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* feat: make installs and tests more consistent, cleanup some deps

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: cleanup

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: mamba backend is cublas only

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

* fix: uncomment lines in makefile

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>

---------

Signed-off-by: Chris Jowett <421501+cryptk@users.noreply.github.com>
 2024-05-10 15:08:08 +02:00
LocalAI [bot]andmudler e6768097f4 ⬆️ Update docs version mudler/LocalAI (#2280) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-10 09:10:00 +02:00
LocalAI [bot]andmudler 18a04246fa ⬆️ Update ggerganov/llama.cpp (#2281) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-09 22:18:49 +00:00
LocalAI [bot]andmudler f69de3be0d models(gallery): ⬆️ update checksum (#2278) 
⬆️ Checksum updates in gallery/index.yaml

Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
v2.15.0 		2024-05-09 12:21:24 +00:00
Ettore Di Giacinto 650ae620c5 ci: get latest git version 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 11:33:16 +02:00
Ettore Di Giacinto 6a209cbef6 ci: get file name correctly in checksum_checker.sh 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 10:57:23 +02:00
Ettore Di Giacinto 9786bb826d ci: try to fix checksum_checker.sh 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 09:34:07 +02:00
Ettore Di Giacinto 9b4c6f348a Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:57:22 +02:00
Ettore Di Giacinto cb6ddb21ec Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:55:48 +02:00
Ettore Di Giacinto 0baacca605 Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:54:35 +02:00
Ettore Di Giacinto 222d714ec7 Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:51:57 +02:00
Ettore Di Giacinto fd2d89d37b Update checksum_checker.sh 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:43:16 +02:00
Ettore Di Giacinto 6440b608dc Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:42:48 +02:00
Ettore Di Giacinto 1937118eab Update checksum_checker.yaml 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-09 00:34:56 +02:00
Ettore Di Giacinto bc272d1e4b ci: add checksum checker pipeline (#2274) 
Signed-off-by: mudler <mudler@localai.io>
 2024-05-09 00:31:27 +02:00
LocalAI [bot]andmudler d651f390cd ⬆️ Update ggerganov/whisper.cpp (#2273) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-08 22:11:10 +00:00
Ettore Di Giacinto ea777f8716 models(gallery): update SHA for einstein 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-08 23:40:58 +02:00
LocalAI [bot]andmudler eca5200fbd ⬆️ Update ggerganov/llama.cpp (#2272) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-08 21:34:56 +00:00
Ettore Di Giacinto 0809e9e7a0 models(gallery): fix openbiollm typo 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-08 23:19:43 +02:00
LocalAI [bot]andmudler b66baa3db6 ⬆️ Update docs version mudler/LocalAI (#2271) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-08 21:10:30 +00:00
Ettore Di Giacinto 6eb77f0d3a models(gallery): add tiamat (#2269) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:59:42 +02:00
Ettore Di Giacinto b20354b3ad models(gallery): add aurora (#2270) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:55:39 +02:00
Ettore Di Giacinto d6f76c75e1 models(gallery): add kunocchini (#2268) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:52:08 +02:00
Ettore Di Giacinto ed4f412f1c models(gallery): add lumimaid variant (#2267) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:51:53 +02:00
Ettore Di Giacinto 5bf56e01aa models(gallery): add tess (#2266) 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:51:44 +02:00
Ettore Di Giacinto 5ff5f0b393 fix(ux): fix small glitches (#2265) 
also drop duplicates for displaying in-progress model ops

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
 2024-05-08 19:34:33 +02:00
Ettore Di Giacinto 6559ac11b1 feat(ui): prompt for chat, support vision, enhancements (#2259) 
* feat(ui): allow to set system prompt for chat

Make also the models in the index clickable, and display as table

Fixes #2257

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(vision): support also png with base64 input

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(ui): support vision and upload of files

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* display the processed image

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* make trust remote code stand out

Signed-off-by: mudler <mudler@localai.io>

* feat(ui): track in progress job across index/model gallery

Signed-off-by: mudler <mudler@localai.io>

* minor fixups

Signed-off-by: mudler <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: mudler <mudler@localai.io>
 2024-05-08 00:42:34 +02:00
Ettore Di Giacinto 02ec546dd6 models(gallery): Add Soliloquy (#2260) 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-08 00:14:19 +02:00
LocalAI [bot]andmudler 995aa5ed21 ⬆️ Update ggerganov/llama.cpp (#2263) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-07 21:39:12 +00:00
Michael Mior e28ba4b807 Add missing Homebrew dependencies (#2256) 
Signed-off-by: Michael Mior <michael.mior@gmail.com>
Signed-off-by: Michael Mior <mmior@mail.rit.edu>
 2024-05-07 16:34:30 +00:00
Daniel d1e3436de5 Update readme: add ShellOracle to community integrations (#2254) 
Signed-off-by: Daniel Copley <djcopley@users.noreply.github.com>
 2024-05-07 08:39:58 +02:00
Dave d3ddc9e4aa UI: flag trust_remote_code to users // favicon support (#2253) 
* attempt to indicate trust_remote_code in some way

* bonus: favicon support!

---------

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-05-07 08:39:23 +02:00
fakezeta fea9522982 fix: OpenVINO winograd always disabled (#2252) 
Winograd convolutions were always disabled giving error when inference device was CPU.
This commit implement logic to disable Winograd convolutions only if CPU or NPU are declared.
 2024-05-07 08:38:58 +02:00
Ettore Di Giacinto fe055d4b36 feat(webui): ux improvements (#2247) 
* ux: change welcome when there are no models installed

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ux: filter

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ux: show tags in filter

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* wip

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* make tags clickable

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* allow to delete models from the list

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* ui: display icon of installed models

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* gallery: remove gallery file when removing model

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat(gallery): show a re-install button

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* make filter buttons, rename Gallery field

Signed-off-by: mudler <mudler@localai.io>

* show again buttons at end of operations

Signed-off-by: mudler <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
Signed-off-by: mudler <mudler@localai.io>
 2024-05-07 01:17:07 +02:00
LocalAI [bot]andmudler 581b894789 ⬆️ Update ggerganov/llama.cpp (#2255) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-06 21:28:07 +00:00
Ettore Di Giacinto 477655f6e6 models(gallery): average_norrmie reupload 
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com>
 2024-05-06 19:56:24 +02:00
fakezeta 169d8d21ff gallery: Added some OpenVINO models (#2249) 
* Added some OpenVINO models

Added Phi-3 trust_remote_code: true
Added Hermes 2 Pro Llama3
Added Multilingual-E5-base embedding model with OpenVINO acceleration (CPU and XPU)
Added all-MiniLM-L6-v2 with OpenVINO acceleration (CPU and XPU)

* Added Remote Code for phi, fixed error on Yamllint

* update openvino.yaml

I need to go to rest: today is not my day...
 2024-05-06 10:52:05 +02:00
LocalAI [bot]andmudler c5475020fe ⬆️ Update ggerganov/llama.cpp (#2251) 
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com>
 2024-05-05 21:16:00 +00:00
Dave b52ff1249f test: check the response URL during image gen in app_test.go (#2248) 
test: actually check the response URL from image gen

Signed-off-by: Dave Lee <dave@gray101.com>
 2024-05-05 18:46:33 +00:00