Ettore Di Giacinto ee8d796f93 docs: design model failover chains ...

A model served from a remote upstream has no local fallback when that
upstream is unhealthy, so clients reimplement failover and lose realtime
context when they switch endpoints.

Define a failover block on model configs: an ordered list of targets with
active probes, in-request retry before the response is committed,
fail-back with hysteresis, and switch events over REST, SSE and the
realtime socket.

Assisted-by: Claude:claude-opus-5-5
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-09-27 07:42:20 +00:00

..

plans

feat(backends): add Whisper-Medusa transcription

2026-09-11 21:48:07 +00:00

specs

docs: design model failover chains

2026-09-27 07:42:20 +00:00