Ettore Di Giacinto
6644af10c6
feat: ⚠️ reduce images size and stop bundling sources ( #5721 )
...
feat: reduce images size and stop bundling sources
Do not copy sources anymore, and reduce packages of the base images by
not using builder images.
If needed to rebuild, just build the container image from scratch by
following the docs. We will slowly try to migrate all backends to the
gallery to keep the core small.
This PR is a breaking change, it also sets the base folders to /models
and /backends instead of /build/models and /build/backends.
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Signed-off-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2025-06-26 18:41:38 +02:00
Ettore Di Giacinto
7b1e792732
deps(llama.cpp): bump to latest, update build variables ( #2669 )
...
* arrow_up: Update ggerganov/llama.cpp
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* deps(llama.cpp): update build variables to follow upstream
Update build recipes with https://github.com/ggerganov/llama.cpp/pull/8006
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs by default in llama.cpp
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable shared libs in llama.cpp Makefile
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* Disable metal embedding for now, until it is tested
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix(mac): explicitly enable metal
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* debug
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* fix typo
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
---------
Signed-off-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
Co-authored-by: mudler <2420543+mudler@users.noreply.github.com >
2024-06-27 23:10:04 +02:00
cryptk
86bc5f1350
fix: use exec in entrypoint scripts to fix signal handling ( #1943 )
2024-04-02 09:15:44 +02:00
Ettore Di Giacinto
ddd21f1644
feat: Use ubuntu as base for container images, drop deprecated ggml-transformers backends ( #1689 )
...
* cleanup backends
* switch image to ubuntu 22.04
* adapt commands for ubuntu
* transformers cleanup
* no contrib on ubuntu
* Change test model to gguf
* ci: disable bark tests (too cpu-intensive)
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* cleanup
* refinements
* use intel base image
* Makefile: Add docker targets
* Change test model
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-02-08 20:12:51 +01:00
Ettore Di Giacinto
1c57f8d077
feat(sycl): Add support for Intel GPUs with sycl ( #1647 ) ( #1660 )
...
* feat(sycl): Add sycl support (#1647 )
* onekit: install without prompts
* set cmake args only in grpc-server
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
* cleanup
* fixup sycl source env
* Cleanup docs
* ci: runs on self-hosted
* fix typo
* bump llama.cpp
* llama.cpp: update server
* adapt to upstream changes
* adapt to upstream changes
* docs: add sycl
---------
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2024-02-01 19:21:52 +01:00
Ettore Di Giacinto
3a4fb6fa4b
feat(entrypoint): optionally prepare extra endpoints ( #1405 )
...
entrypoint: optionally prepare extra endpoints
Signed-off-by: Ettore Di Giacinto <mudler@localai.io >
2023-12-08 20:04:13 +01:00
Gianluca Boiano
bde87d00b9
deps(go-piper): update to 2023.11.6-3 ( #1257 )
...
Signed-off-by: Gianluca Boiano <morf3089@gmail.com >
2023-11-11 18:40:26 +01:00
finger42
72e3e236de
Added CPU information to entrypoint.sh ( #794 )
2023-07-23 19:27:55 +00:00
mudler
4de7f55f2f
Make REBUILD=false default behavior
...
Add notice to documentation
Signed-off-by: mudler <mudler@localai.io >
2023-07-07 00:29:14 +02:00
Ettore Di Giacinto
92614b91d7
fix: split build threads from running threads ( #703 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-29 11:57:09 +02:00
Matthew Koski
c2dec387aa
Update entrypoint.sh to use $THREADS for parallel compilation on start if present ( #673 )
2023-06-26 14:48:24 +02:00
Ettore Di Giacinto
a7bb029d23
feat: add tts with go-piper ( #649 )
...
Signed-off-by: mudler <mudler@localai.io >
2023-06-22 17:53:10 +02:00
Ettore Di Giacinto
6d71dd7d98
fix: do not build from the same container ( #434 )
...
Signed-off-by: mudler <mudler@mocaccino.org >
2023-05-30 15:53:37 +02:00
Sébastien Prud'homme
1a7587ee48
feat: add an environment variable to manage rebuild in Docker image ( #290 )
...
Co-authored-by: Ettore Di Giacinto <mudler@users.noreply.github.com >
2023-05-18 19:18:32 +02:00
Ettore Di Giacinto
16773e2a35
feat: make images to build sources on start ( #124 )
...
Signed-off-by: mudler <mudler@mocaccino.org >
2023-04-29 20:38:37 +02:00
