Ettore Di Giacinto ca23d05c66 feat(realtime): speechStreamer for token-streamed LLM->TTS ...

emitSpeech now returns raw PCM (caller base64-encodes) so streamed segments
accumulate correctly. speechStreamer consumes streamed LLM tokens: it strips
reasoning via the streaming ReasoningExtractor, emits a transcript delta per
content fragment, and sentence-pipes content into emitSpeech so each sentence
is synthesized as soon as it's ready. Handler wiring (plain-content turns)
follows.

Assisted-by: Claude:claude-opus-4-8 go vet
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>

2026-06-05 14:03:36 +00:00

..

types

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

chat_assistant_gate_test.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

chat_assistant_gate.go

chore: Security hardening (#9719)

2026-05-08 16:25:45 +02:00

chat_emit_test.go

fix(streaming): comply with OpenAI usage / stream_options spec (#9815)

2026-05-14 08:53:46 +02:00

chat_emit.go

fix(openai): stream usage non-zero when tools are enabled (#9941)

2026-05-22 10:13:41 +02:00

chat_stream_reasoning_test.go

fix(streaming/tools): don't leak prefill-misclassified content as trailing reasoning chunk (#10000)

2026-05-26 08:34:26 +02:00

chat_stream_usage_test.go

fix(openai): stream usage non-zero when tools are enabled (#9941)

2026-05-22 10:13:41 +02:00

chat_stream_workers_test.go

fix(streaming/tools): stop healing-marker stubs from gating off content (#9999)

2026-05-25 23:55:35 +02:00

chat_stream_workers.go

fix(openai): stop streaming tool-call double-emission when autoparser is active (#10055)

2026-05-29 11:39:09 +02:00

chat_test.go

fix(reasoning): stop <think> leaking into content when autoparser is in pure-content mode (#9991)

2026-05-25 22:39:50 +02:00

chat.go

fix(reasoning): stop <think> leaking into content when autoparser is in pure-content mode (#9991)

2026-05-25 22:39:50 +02:00

completion.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

constants.go

fix(api): SSE streaming format to comply with specification (#7182)

2025-11-09 22:00:27 +01:00

diarization_test.go

feat(api): add /v1/audio/diarization endpoint with sherpa-onnx + vibevoice.cpp (#9654)

2026-05-05 15:10:13 +02:00

diarization.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00

edit.go

feat(middleware): Model routing, PII filtering, Cloud model proxies (#9802)

2026-05-25 09:28:27 +02:00

embeddings.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

image_test.go

Fix image upload processing and img2img pipeline in diffusers backend (#8879)

2026-03-11 08:05:50 +01:00

image.go

security(http): refuse redirects on outbound clients via hardened pkg/httpclient (#10087)

2026-05-30 12:04:10 +02:00

inference_test.go

fix: thinking models with tools returning empty content (reasoning-only retry loop) (#9290)

2026-04-09 18:30:31 +02:00

inference.go

fix: thinking models with tools returning empty content (reasoning-only retry loop) (#9290)

2026-04-09 18:30:31 +02:00

inpainting_test.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

inpainting.go

feat(distributed): gated X-LocalAI-Node response header (middleware + wrapper) (#9976)

2026-05-25 10:51:48 +02:00

list.go

feat(api): Allow coding agents to interactively discover how to control and configure LocalAI (#9084)

2026-04-04 15:14:35 +02:00

openai_suite_test.go

Fix image upload processing and img2img pipeline in diffusers backend (#8879)

2026-03-11 08:05:50 +01:00

realtime_doubles_test.go

feat(realtime): emitSpeech with flag-gated streaming TTS

2026-06-05 14:03:36 +00:00

realtime_gate_test.go

feat(realtime): Add Liquid Audio s2s model and assistant mode on talk page (#9801)

2026-05-13 21:57:27 +02:00

realtime_modality_test.go

realtime: honor output_modalities to skip TTS in text-only mode (#9838)

2026-05-15 12:39:47 +02:00

realtime_model.go

feat(realtime): pipeline disable_thinking maps to enable_thinking off

2026-06-05 14:03:36 +00:00

realtime_reasoning_test.go

feat: forward reasoning_effort to the backend so jinja models honor it (#10184)

2026-06-05 13:45:43 +00:00

realtime_reasoning.go

feat: forward reasoning_effort to the backend so jinja models honor it (#10184)

2026-06-05 13:45:43 +00:00

realtime_segmenter_test.go

feat(realtime): sentence segmenter for streamed LLM->TTS pipelining

2026-06-05 14:03:36 +00:00

realtime_segmenter.go

feat(realtime): sentence segmenter for streamed LLM->TTS pipelining

2026-06-05 14:03:36 +00:00

realtime_speech_test.go

feat(realtime): speechStreamer for token-streamed LLM->TTS

2026-06-05 14:03:36 +00:00

realtime_speech.go

feat(realtime): speechStreamer for token-streamed LLM->TTS

2026-06-05 14:03:36 +00:00

realtime_stream_test.go

feat(realtime): speechStreamer for token-streamed LLM->TTS

2026-06-05 14:03:36 +00:00

realtime_stream.go

feat(realtime): speechStreamer for token-streamed LLM->TTS

2026-06-05 14:03:36 +00:00

realtime_thinking_test.go

feat(realtime): pipeline disable_thinking maps to enable_thinking off

2026-06-05 14:03:36 +00:00

realtime_thinking.go

feat(realtime): pipeline disable_thinking maps to enable_thinking off

2026-06-05 14:03:36 +00:00

realtime_transcription_test.go

feat(realtime): streaming transcription text deltas

2026-06-05 14:03:36 +00:00

realtime_transcription.go

feat(realtime): streaming transcription text deltas

2026-06-05 14:03:36 +00:00

realtime_transport_webrtc.go

feat: add distributed mode (#9124)

2026-03-30 00:47:27 +02:00

realtime_transport_ws.go

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

realtime_transport.go

feat(realtime): WebRTC support (#8790)

2026-03-13 21:37:15 +01:00

realtime_webrtc.go

feat(realtime): Add Liquid Audio s2s model and assistant mode on talk page (#9801)

2026-05-13 21:57:27 +02:00

realtime.go

feat(realtime): speechStreamer for token-streamed LLM->TTS

2026-06-05 14:03:36 +00:00

transcription.go

feat(whisper): honor client cancellation via ggml abort_callback (#9710)

2026-05-08 01:44:47 +02:00