Ettore Di Giacinto c844b7ac58 feat: disable force eviction (#7725) ...

* feat: allow to set forcing backends eviction while requests are in flight

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* feat: try to make the request sit and retry if eviction couldn't be done

Otherwise calls that in order to pass would need to shutdown other
backends would just fail.

In this way instead we make the request sit and retry eviction until it
succeeds. The thresholds can be configured by the user.

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* add tests

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* expose settings to CLI

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

* Update docs

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

---------

Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2025-12-25 14:26:18 +01:00

..

elevenlabs

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00

explorer

feat: migrate to echo and enable cancellation of non-streaming requests (#7270)

2025-11-14 22:57:53 +01:00

jina

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00

localai

feat: disable force eviction (#7725)

2025-12-25 14:26:18 +01:00

mcp

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00

openai

chore(refactor): move logging to common package based on slog (#7668)

2025-12-21 19:33:13 +01:00