LocalAI [bot] 7d2a762b53 feat(realtime): configurable pipeline.max_history_items (#10331) ...

Composed realtime pipelines (VAD+STT+LLM+TTS) defaulted to unlimited history,
so a long-running session grew every turn and fed the whole conversation to the
LLM until its context window filled. Add an optional pipeline.max_history_items
to cap the trailing items per turn; explicit value (including 0=unlimited) wins
over the per-model-type default. Self-contained any-to-any models keep their
6-item default.

Co-authored-by: Ettore Di Giacinto <mudler@localai.io>
Co-authored-by: Claude Opus 4.8 (1M context) <noreply@anthropic.com>

2026-06-14 18:13:09 +02:00

..

types

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

chat_assistant_gate_test.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

chat_assistant_gate.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

chat_emit_test.go

fix(streaming): comply with OpenAI usage / stream_options spec (#9815)

2026-05-14 08:53:46 +02:00

chat_emit.go

fix(openai): stream usage non-zero when tools are enabled (#9941)

2026-05-22 10:13:41 +02:00

chat_stream_reasoning_test.go

fix(streaming/tools): don't leak prefill-misclassified content as trailing reasoning chunk (#10000)

2026-05-26 08:34:26 +02:00

chat_stream_usage_test.go

fix(openai): stream usage non-zero when tools are enabled (#9941)

2026-05-22 10:13:41 +02:00

chat_stream_workers_test.go

fix(streaming/tools): stop healing-marker stubs from gating off content (#9999)

2026-05-25 23:55:35 +02:00

chat_stream_workers.go

fix(openai): stop streaming tool-call double-emission when autoparser is active (#10055)

2026-05-29 11:39:09 +02:00

chat_test.go

fix(reasoning): stop prefilled <think> from swallowing tag-less answers (#10225)

2026-06-09 09:02:04 +02:00

chat.go

fix(reasoning): stop prefilled <think> from swallowing tag-less answers (#10225)

2026-06-09 09:02:04 +02:00

completion.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

constants.go

fix(api): SSE streaming format to comply with specification (#7182)

2025-11-09 22:00:27 +01:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

edit.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

embeddings.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

image_test.go

Fix image upload processing and img2img pipeline in diffusers backend (#8879)

2026-03-11 08:05:50 +01:00

image.go

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

inference_test.go

fix: thinking models with tools returning empty content (reasoning-only retry loop) (#9290)

2026-04-09 18:30:31 +02:00

inference.go

fix: thinking models with tools returning empty content (reasoning-only retry loop) (#9290)

2026-04-09 18:30:31 +02:00

inpainting_test.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

inpainting.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

list.go

feat(api): Allow coding agents to interactively discover how to control and configure LocalAI (#9084)

2026-04-04 15:14:35 +02:00

openai_suite_test.go

Fix image upload processing and img2img pipeline in diffusers backend (#8879)

2026-03-11 08:05:50 +01:00

realtime_chunker_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_chunker.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_doubles_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_gate_test.go

feat(realtime): configurable pipeline.max_history_items (#10331)

2026-06-14 18:13:09 +02:00

realtime_modality_test.go

realtime: honor output_modalities to skip TTS in text-only mode (#9838)

2026-05-15 12:39:47 +02:00

realtime_model.go

fix(router): production-ready request router + auto-size batch for embedding/rerank (#10104)

2026-06-12 16:21:15 +02:00

realtime_reasoning_test.go

feat: forward reasoning_effort to the backend so jinja models honor it (#10184)

2026-06-05 13:45:43 +00:00

realtime_reasoning.go

feat: forward reasoning_effort to the backend so jinja models honor it (#10184)

2026-06-05 13:45:43 +00:00

realtime_speech_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_speech.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_stream_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_stream.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_thinking_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_thinking.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_transcription_test.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_transcription.go

feat(realtime): stream the LLM / TTS / transcription pipeline stages (#10176)

2026-06-11 08:43:12 +01:00

realtime_transport_webrtc.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

realtime_transport_ws.go

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

realtime_transport.go

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

realtime_voicegate_integration_test.go

feat(realtime): gate realtime pipeline voice models behind voice recognition (#10319)

2026-06-13 23:38:08 +02:00

realtime_voicegate_test.go

feat(realtime): gate realtime pipeline voice models behind voice recognition (#10319)

2026-06-13 23:38:08 +02:00

realtime_voicegate.go

feat(realtime): gate realtime pipeline voice models behind voice recognition (#10319)

2026-06-13 23:38:08 +02:00

realtime_webrtc_ice_test.go

feat(realtime): make WebRTC ICE candidates configurable (#10231)

2026-06-09 22:28:03 +02:00

realtime_webrtc_ice.go

feat(realtime): make WebRTC ICE candidates configurable (#10231)

2026-06-09 22:28:03 +02:00

realtime_webrtc.go

feat(realtime): make WebRTC ICE candidates configurable (#10231)

2026-06-09 22:28:03 +02:00

realtime.go

feat(realtime): configurable pipeline.max_history_items (#10331)

2026-06-14 18:13:09 +02:00

transcription.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00