mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 17:18:49 -04:00
The vLLM and SGLang backends no longer stop at 200 tokens when a request has no max_tokens. Generation is now bounded by the context window. Assisted-by: Claude:claude-sonnet-5-5 Signed-off-by: Ettore Di Giacinto <mudler@localai.io>