mirror of
https://github.com/mudler/LocalAI.git
synced 2026-11-03 11:04:53 -05:00
gallery: add Nemotron 3 embedding models (#11314)
Add multilingual 1B and 8B Q4_K_M GGUF embedding entries and link them as variants for automatic memory-aware selection. Assisted-by: Codex:gpt-5 [web] Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
This commit is contained in:
1 parent
af98e76f84
commit
cd62e8ff18
1 file changed
+55
@@ -1,4 +1,59 @@
|
|||||||
---
|
---
|
||||||
|
- &nemotron-3-embed-1b
|
||||||
|
name: "nemotron-3-embed-1b-q4"
|
||||||
|
url: "github:mudler/LocalAI/gallery/virtual.yaml@master"
|
||||||
|
variants:
|
||||||
|
- model: nemotron-3-embed-8b-q4
|
||||||
|
license: openmdw-1.1
|
||||||
|
urls:
|
||||||
|
- https://huggingface.co/nvidia/Nemotron-3-Embed-1B-BF16
|
||||||
|
- https://huggingface.co/zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF
|
||||||
|
description: |
|
||||||
|
Nemotron-3-Embed-1B is NVIDIA's multilingual text embedding model for
|
||||||
|
retrieval, semantic search, and RAG. This compact Q4_K_M GGUF produces
|
||||||
|
2,048-dimensional normalized embeddings and supports 36 languages. Prefix
|
||||||
|
retrieval queries with `query: ` and documents with `passage: `.
|
||||||
|
tags:
|
||||||
|
- embeddings
|
||||||
|
- multilingual
|
||||||
|
- retrieval
|
||||||
|
- rag
|
||||||
|
- gguf
|
||||||
|
- cpu
|
||||||
|
- gpu
|
||||||
|
overrides:
|
||||||
|
backend: llama-cpp
|
||||||
|
embeddings: true
|
||||||
|
known_usecases:
|
||||||
|
- embeddings
|
||||||
|
parameters:
|
||||||
|
model: llama-cpp/models/nemotron-3-embed-1b-q4_k_m.gguf
|
||||||
|
files:
|
||||||
|
- filename: llama-cpp/models/nemotron-3-embed-1b-q4_k_m.gguf
|
||||||
|
uri: huggingface://zenmagnets/Nemotron-3-Embed-1B-Q4_K_M-GGUF/nemotron-3-embed-1b-q4_k_m.gguf
|
||||||
|
sha256: 9a74166f51dbc280073748fa199bea49283bd21f7f9280f2dec2b4d975ddfd1d
|
||||||
|
- !!merge <<: *nemotron-3-embed-1b
|
||||||
|
name: "nemotron-3-embed-8b-q4"
|
||||||
|
variants: []
|
||||||
|
urls:
|
||||||
|
- https://huggingface.co/nvidia/Nemotron-3-Embed-8B-BF16
|
||||||
|
- https://huggingface.co/Abiray/Nemotron-3-Embed-8B-GGUF
|
||||||
|
description: |
|
||||||
|
Nemotron-3-Embed-8B is NVIDIA's larger multilingual text embedding model
|
||||||
|
for retrieval, semantic search, and RAG. This Q4_K_M GGUF balances retrieval
|
||||||
|
quality with local resource use and supports 36 languages. Prefix retrieval
|
||||||
|
queries with `query: ` and documents with `passage: `.
|
||||||
|
overrides:
|
||||||
|
backend: llama-cpp
|
||||||
|
embeddings: true
|
||||||
|
known_usecases:
|
||||||
|
- embeddings
|
||||||
|
parameters:
|
||||||
|
model: llama-cpp/models/Nemotron-3-Embed-8B-Q4_K_M.gguf
|
||||||
|
files:
|
||||||
|
- filename: llama-cpp/models/Nemotron-3-Embed-8B-Q4_K_M.gguf
|
||||||
|
uri: huggingface://Abiray/Nemotron-3-Embed-8B-GGUF/Nemotron-3-Embed-8B-Q4_K_M.gguf
|
||||||
|
sha256: a2aa29c618da6eed10d9474e72e33188c61e5fd700aed2fe9a1d98abdc90c6fc
|
||||||
- &grug-27b
|
- &grug-27b
|
||||||
name: "grug-27b"
|
name: "grug-27b"
|
||||||
variants:
|
variants:
|
||||||
|
|||||||
Reference in new issue
Block a user