mirror/LocalAI
1
0 Fork 0
mirror of https://github.com/mudler/LocalAI.git synced 2026-10-03 11:34:35 -04:00
Code Issues Packages Projects Releases Wiki Activity

feat(quantization): add quantization backend (#9096)

Browse Source 
Signed-off-by: Ettore Di Giacinto <mudler@localai.io>
This commit is contained in:
Ettore Di Giacinto authored and GitHub committed 2026-03-22 00:56:34 +01:00
1 parent 4b183b7bb6
commit f7e8d9e791
37 files changed
+2574 -47
Download Patch File Download Diff File Expand all files Collapse all files

No files matched your search

backend/python/llama-cpp-quantization/requirements-cpu.txt
+5
View File
@@ -0,0 +1,5 @@
--extra-index-url https://download.pytorch.org/whl/cpu
torch==2.10.0
transformers>=4.56.2
huggingface-hub>=1.3.0
sentencepiece