mirror of
https://github.com/mudler/LocalAI.git
synced 2026-07-31 02:18:50 -04:00
The "Bump Backend dependencies" workflow has failed every night for over ten days. Four upstreams — ced.cpp, moss-transcribe.cpp, voice-detect.cpp and rf-detr.cpp — moved from the mudler org to localai-org, so the GitHub API answers 301 for the old slugs. ced.cpp additionally renamed its default branch to main. bump_deps.sh fetched without -L or -f and never checked the response, so the redirect's JSON body was passed straight to sed, which died with "unterminated `s' command". The loud failure was luck: an error body without slashes would have been substituted into the Makefile as the new pin, silently corrupting the version and shipping it in a bump PR. Point the matrix at the new slugs and branch, and harden the script so a bad response can never reach sed: follow redirects, fail on HTTP errors, and require a bare 40-hex SHA before rewriting anything. Also refresh the now-stale repository URLs in the backend Makefiles, test scripts, backend/index.yaml and the docs. Verified all 25 matrix entries resolve to a commit SHA and that the four previously-failing jobs run end to end against the real API. Assisted-by: Claude:claude-opus-4-8 [Claude Code] Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
4.4 KiB
4.4 KiB
+++ disableToc = false title = "News" weight = 10 url = '/basics/news/' icon = "newspaper" +++
Release notes have been now moved completely over Github releases.
You can see the release notes here.
2026 Highlights
- July 2026: LongCat video and avatar generation - dedicated CUDA backend for
LongCat-Videotext/image-to-video andLongCat-Video-Avatar-1.5speech-driven avatars. Includes multi-segment continuation, portrait and recorded-audio inputs in Studio, and an SDPA CUDA 13 ARM64 build for DGX Spark. - April 2026: Audio Transform - generic audio-in / audio-out endpoint with optional reference signal. First implementation: LocalVQE C++ backend (joint AEC + noise suppression + dereverberation, DeepVQE-style). Both batch (
POST /audio/transformations) and bidirectional WebSocket streaming (/audio/transformations/stream). Studio "Transform" tab with synchronized waveform players for input / reference / output. - April 2026: Face recognition backend -
insightface-powered 1:1 verification, 1:N identification, face embedding, face detection, and demographic analysis. Ships both a non-commercialbuffalo_lmodel and an Apache 2.0 OpenCV Zoo alternative. - May 2026: Speaker diarization - new
/v1/audio/diarizationendpoint returning "who spoke when" segments. Backed bysherpa-onnx(pyannote-3.0 + speaker embeddings + clustering) for pure diarization, andvibevoice-cppfor diarization bundled with long-form ASR. Supportsjson/verbose_json/rttmresponse formats. - June 2026: Sound classification - new
/v1/audio/classificationendpoint for audio tagging / sound-event classification, returning scored AudioSet labels (baby cry, glass breaking, alarms, ...). Backed by ced.cpp, a 527-class AudioSet tagger ported to ggml. - June 2026: PII analyze / redact API - the PII detection pipeline (NER + restricted-regex pattern tiers) is now a standalone service:
POST /api/pii/analyzereturns detected entity spans andPOST /api/pii/redactreturns the sanitised text (or400 pii_blocked), without routing a chat request through the middleware. Events gain anorigin(middleware/proxy/pii_analyze/pii_redact) so/api/pii/eventscan be filtered by source. - July 2026: Model capabilities endpoint -
GET /v1/models/capabilities, an additive superset of/v1/modelsthat reports each model'scapabilitiesplus itsinput_modalities/output_modalities(text/image/audio/video). Lets clients route attachments using inferred or explicitly declared model modalities instead of backend-name checks. - June 2026: Concurrent scoring and PII NER on llama.cpp - the
Score(router classifier) andTokenClassify(PII NER) primitives now ride llama.cpp's server task queue instead of locking the context, so they run concurrently with chat/completion/embedding traffic and with each other. Theknown_usecasesrestriction that forced dedicated scorer/NER model configs on llama-cpp is lifted, repeated scoring calls reuse the prompt KV cache across candidates, and scoring inputs are no longer capped by the physical batch size.
2024 Highlights
- April 2024: Reranker API
- May 2024: Distributed inferencing, Decentralized P2P llama.cpp - Docs
- July/August 2024: P2P Dashboard, Federated mode and AI Swarms, P2P Global community pools, FLUX-1 support, P2P Explorer
- October 2024: Examples moved to LocalAI-examples
- November 2024: Voice Activity Detection (VAD), Bark.cpp backend
- December 2024: stablediffusion.cpp backend (ggml)