LocalAI

0 Fork 0

mirror of https://github.com/mudler/LocalAI.git synced 2026-09-21 13:44:55 -04:00

Files

T

Ettore Di Giacinto a2e5c90ff0 feat(vllm-cpp): add kev-compatible SystemOne API endpoints

Add POST /v1/systemone, /v1/systemone/permute, and
/v1/systemone/separate to LocalAI, mirroring the kev project's
structured-extraction API. Each endpoint runs zero-shot NER over the
rendered state text and builds kev-compatible answers for three question
types: noul (binary entity presence), choice (pick one option), and
score (pick one level).

The TokenClassifyRequest proto gains a `repeated string labels` field so
each question can supply its own labels at inference time, and
TokenClassifier gains TokenClassifyWithLabels for per-call label
selection. The vllm-cpp backend uses request labels when non-empty,
falling back to configured ner_labels then the built-in defaults.

Helpers (renderState, softmax, choiceConfidence, scoreConfidence, r2)
are ported from kev/api.py and mirrored in vllm.cpp's api_server.cpp so
both servers produce the same answer shape.

Following-Agents-Protocol: true
AI-Assisted: true
Assisted-by: AGENT:regolo/glm5.2 [maki]

2026-09-20 10:34:03 +00:00

auth

feat: Add kimodo.cpp and 3D animation API/UI (#12095 )

2026-09-18 06:12:03 +01:00

endpoints

feat(vllm-cpp): add kev-compatible SystemOne API endpoints

2026-09-20 10:34:03 +00:00

middleware

fix(ollama): accept :latest tag on model lookup (#11732 )

2026-08-26 08:57:36 +02:00

react-ui

fix(ui): make text selection visibly contrast the background (#12123 )