mirror/LocalAI
1
0
Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-07-03 04:46:54 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
2efb0ec362fb01939efc436011fe691e186c0bc2
LocalAI/backend/cpp/llama-cpp-localai-paged/patches/paged
History
Ettore Di Giacinto 9f75da01f9 feat(paged): add cublas tensor-name trace patch 
Add patch 0063 extending LLAMA_CUBLAS_ROUTE_TRACE with src0/src1/dst tensor names.

Record Phase 37 gates and the conclusion that SGEMM traces to MoE gate tensors.

Assisted-by: Codex:gpt-5
2026-07-01 06:41:00 +00:00
..
0001-vendor-paged-kv-manager.patch
paged-kv-manager.h: add missing <cstddef> for size_t
2026-06-28 04:09:16 +00:00
0002-paged-kv-block-placement-env-LLAMA_KV_PAGED.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0003-paged-gather-read-env-LLAMA_KV_PAGED.patch
paged headers: self-include <cstddef>/<cstdint> for size_t/uintN_t (fix amd64/non-arm64 build; compile-only)
2026-06-28 06:18:56 +00:00
0004-paged-on-demand-block-allocation-env-LLAMA_KV_PAGED.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0006-paged-cross-request-prefix-caching-env-LLAMA_KV_PAGED.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0007-paged-engine-prefix-recompute-skip-env-LLAMA_KV_PAGED.patch
paged headers: self-include <cstddef>/<cstdint> for size_t/uintN_t (fix amd64/non-arm64 build; compile-only)
2026-06-28 06:18:56 +00:00
0008-paged-server-cross-request-prefix-share-env-LLAMA_KV_PAGED.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0009-paged-in-kernel-decode-read-env-LLAMA_KV_PAGED-patch.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0010-paged-tile-in-kernel-read-and-dispatch-guard-env-LLAMA_KV_PAGED.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0011-paged-decode-route-GQA-grouped-tile-kernel-by-defaul.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0012-paged-mask-pad-invariant-assert.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0013-paged-decoupled-prefill-token-budget.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0014-paged-expert-aware-moe-token-tile-cap.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0015-paged-expert-density-aware-moe-token-tile-auto-select.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0016-paged-dynamic-prefill-budget-continuous-batch.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0017-fp4-gemm-decode-tile-tune.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0018-qwen35-ssm-decode-inplace-state.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0019-qwen35-ssm-decode-fused-gather.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0020-qwen35-gdn-oproj-mmq-reshape.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0021-qwen35-conv-state-inplace-fusion.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0022-qwen35-gdn-recurrence-occupancy-retune.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0023-qwen35moe-nvfp4-quant-dedup.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0024-paged-pool-burst-reclaim.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0025-qwen35moe-nvfp4-moe-decode-regraph.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0028-qwen35-recurrent-state-gather-fusion.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0029-qwen35-blocktable-within-step-cache.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0030-fused-op-backend-gate.patch
refactor(paged): stock llama-cpp is patch-free; paged backend owns its patch series
2026-06-27 11:01:22 +00:00
0031-paged-chunked-gdn-prefill-scan-kernel.patch
fix(paged): make patch 0031 apply on the 0001-0030 base; default S3 on under paged KV
2026-06-28 19:37:05 +00:00
0033-fp4-prefill-large-m-bf16-cublas-scaffold.patch
feat(paged): FP4 prefill large-M dequant->bf16 cuBLAS scaffold (patch 0033, default-off)
2026-06-28 17:42:15 +00:00
0034-feat-paged-native-NVFP4-W4A4-FP4-MMA-large-M-prefill.patch
feat(paged): tail-fusion (0042) + full-step decode CUDA graph default-on (0043); FP4-MMA W4A4 (0034) + Marlin W4A16 (0035) MoE-GEMM scaffolds default-off
2026-06-29 06:15:10 +00:00
0035-feat-paged-marlin-w4a16-grouped-moe-prefill-gemm.patch
feat(paged): tail-fusion (0042) + full-step decode CUDA graph default-on (0043); FP4-MMA W4A4 (0034) + Marlin W4A16 (0035) MoE-GEMM scaffolds default-off
2026-06-29 06:15:10 +00:00
0040-feat-paged-S1-paged-decode-graph-reuse-across-servin.patch
feat(paged): close the continuous-serving decode gap (S1+S3, patches 0040/0041)
2026-06-28 18:04:28 +00:00
0041-feat-paged-S3-decode-shape-stable-scheduling-patch-0.patch
fix(paged): revert S3 decode-stable scheduler to default-OFF (A/B regression)
2026-06-29 05:00:11 +00:00
0042-feat-paged-fused-residual-add-RMS-norm-weight-multip.patch
feat(paged): tail-fusion (0042) + full-step decode CUDA graph default-on (0043); FP4-MMA W4A4 (0034) + Marlin W4A16 (0035) MoE-GEMM scaffolds default-off
2026-06-29 06:15:10 +00:00
0043-feat-paged-default-on-full-step-moe-decode-cuda-graph.patch
feat(paged): tail-fusion (0042) + full-step decode CUDA graph default-on (0043); FP4-MMA W4A4 (0034) + Marlin W4A16 (0035) MoE-GEMM scaffolds default-off
2026-06-29 06:15:10 +00:00
0044-feat-paged-fused-gated-RMSNorm-SiLU-gate-mul.patch
patches(paged): track 0044 GatedRMSNorm patch, sync LocalAI series to fork 51168c5
2026-06-30 15:10:13 +00:00
0046-paged-gate-GDN-prefill-geometry-by-scan-length.patch
fix(paged): repair the patch series, sync to the fork branch (drop dev-tree 0044/0045, add f32-only M5 as 0047)
2026-06-30 07:54:46 +00:00
0047-paged-GDN-M5-tensor-core-chunked-scan-f32.patch
fix(paged): repair the patch series, sync to the fork branch (drop dev-tree 0044/0045, add f32-only M5 as 0047)
2026-06-30 07:54:46 +00:00
0048-feat-paged-pack-W4A16-grouped-tile-metadata.patch
patches(paged): mirror W4A16 packed metadata
2026-06-30 21:21:53 +00:00
0049-feat-paged-tune-W4A16-grouped-tile-shape.patch
patches(paged): tune W4A16 grouped tile shape
2026-06-30 21:57:42 +00:00
0050-feat-paged-pad-W4A16-A-shared-tile-stride.patch
patches(paged): pad W4A16 A shared tile stride
2026-06-30 22:15:21 +00:00
0051-test-paged-cover-MoE-swiglu-down-chain.patch
test(paged): mirror MoE swiglu down gate
2026-06-30 23:20:52 +00:00
0052-test-paged-cover-MoE-weighted-combine-chain.patch
test(paged): mirror MoE weighted combine gate
2026-06-30 23:51:52 +00:00
0053-test-paged-cover-ragged-MoE-dispatch.patch
test(paged): mirror ragged MoE dispatch gate
2026-07-01 00:41:21 +00:00
0054-fix-speculative-disable-backend-sampling-for-MTP-drafts.patch
fix(paged): gate MTP backend sampling
2026-07-01 00:54:25 +00:00
0055-feat-server-trace-speculative-batch-shapes.patch
docs(paged): add MTP shape trace patch
2026-07-01 02:54:29 +00:00
0056-feat-cuda-trace-moe-mmq-batch-shapes.patch
feat(paged): add moe mmq shape trace patch
2026-07-01 04:32:12 +00:00
0057-feat-cuda-trace-moe-mmq-launch-shapes.patch
feat(paged): add moe mmq launch trace patch
2026-07-01 04:54:33 +00:00
0058-feat-cuda-trace-moe-small-m-mmq-candidates.patch
feat(paged): add moe small-m mmq candidate trace
2026-07-01 05:08:31 +00:00
0059-feat-cuda-gate-moe-small-m-mmq-tile-policy.patch
feat(paged): add moe small-m mmq tile policy gate
2026-07-01 05:20:18 +00:00
0060-feat-cuda-trace-moe-mmid-routes.patch
feat(paged): add moe mmid route trace patch
2026-07-01 05:37:53 +00:00
0061-feat-cuda-trace-mul-mat-routes.patch
feat(paged): add mul mat route trace patch
2026-07-01 05:52:09 +00:00
0062-feat-cuda-trace-cublas-routes.patch
feat(paged): add cublas route trace patch
2026-07-01 06:24:46 +00:00
0063-feat-cuda-trace-cublas-tensor-names.patch
feat(paged): add cublas tensor-name trace patch
2026-07-01 06:41:00 +00:00