Claudio Maradonna 30e53f8d9f fix(ds4): enforce generation boundaries (#11821) ...

Clamp requested generation to the usable context after prompt sync while preserving the legacy 256-token fallback for omitted limits.

Constrain each speculative MTP cycle to the remaining request budget so accepted tokens cannot advance beyond the visible output limit.

Assisted-by: Codex:gpt-5.6-sol

Signed-off-by: Claudio Maradonna <git@codeshifter.xyz>

2026-09-02 12:36:10 +02:00

..

.gitignore

feat(ds4): layer-split distributed inference (#10098)

2026-05-31 00:09:55 +02:00

CMakeLists.txt

chore: ⬆️ Update antirez/ds4 to b7e9f0091139999b6c070a57590c447c5741da5c (#11333)

2026-08-04 15:27:03 +02:00

dsml_parser_test.cpp

fix(ds4): separate prefilled reasoning from content (#11802)

2026-09-01 00:06:23 +02:00

dsml_parser.cpp

fix(ds4): separate prefilled reasoning from content (#11802)

2026-09-01 00:06:23 +02:00

dsml_parser.h

fix(ds4): separate prefilled reasoning from content (#11802)

2026-09-01 00:06:23 +02:00

dsml_renderer.cpp

feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache (#9758)

2026-05-11 22:15:47 +02:00

dsml_renderer.h

feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache (#9758)

2026-05-11 22:15:47 +02:00

generation_limits_test.cpp

fix(ds4): enforce generation boundaries (#11821)

2026-09-02 12:36:10 +02:00

generation_limits.h

fix(ds4): enforce generation boundaries (#11821)

2026-09-02 12:36:10 +02:00

grpc-server.cpp

fix(ds4): enforce generation boundaries (#11821)

2026-09-02 12:36:10 +02:00

kv_cache.cpp

feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache (#9758)

2026-05-11 22:15:47 +02:00

kv_cache.h

feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache (#9758)

2026-05-11 22:15:47 +02:00

Makefile

chore: ⬆️ Update antirez/ds4 to 8db89fe083ae4d17c9a2428ccd29803d3ae8f577 (#11768)

2026-08-29 01:04:06 +02:00

package.sh

refactor(backends): extract package-system-libs.sh from 31 package.sh (#11095)

2026-07-30 16:30:49 +02:00

run.sh

feat: add ds4 backend (DeepSeek V4 Flash) with tool calls, thinking, KV cache (#9758)

2026-05-11 22:15:47 +02:00

worker_main.c

feat(ds4): layer-split distributed inference (#10098)

2026-05-31 00:09:55 +02:00