mirror of
https://github.com/mudler/LocalAI.git
synced 2026-10-28 09:08:54 -04:00
feat(gallery): add Nemotron Bolt E4B variants (#12880)
Add Q4 and Q8 GGUF builds with the F16 vision projector. Link the builds as variants and document installation. Assisted-by: Codex:gpt-6 Co-authored-by: localai-org-maint-bot <306269227+localai-org-maint-bot@users.noreply.github.com>
This commit is contained in:
1 parent
4e496bd5bb
commit
a9236ef74c
3 files changed
+220
No files matched your search
@@ -44,6 +44,22 @@ Both views store the view, search, filter, and selection in the URL. Installing
|
||||
from Explore does not move you away from the catalog; the entry updates in place
|
||||
when the operation finishes.
|
||||
|
||||
### Nemotron 3.5 Bolt E4B
|
||||
|
||||
[Nemotron 3.5 Bolt E4B](https://huggingface.co/nvidia/NVIDIA-Nemotron-3.5-Bolt-E4B-BF16)
|
||||
is NVIDIA's Gemma 4 E4B fine-tune for conversational assistants and tool use.
|
||||
The llama.cpp entries include Unsloth's UD-Q4_K_XL and UD-Q8_K_XL builds,
|
||||
the F16 vision projector, and a 32,768-token default context.
|
||||
|
||||
Install with automatic variant selection:
|
||||
|
||||
```bash
|
||||
local-ai models install nemotron-3.5-bolt-e4b-q4
|
||||
```
|
||||
|
||||
To select a build explicitly, use `--variant nemotron-3.5-bolt-e4b-q4`
|
||||
or `--variant nemotron-3.5-bolt-e4b-q8`.
|
||||
|
||||
### MiniCPM-V 4.7 1B
|
||||
|
||||
[MiniCPM-V 4.7 1B](https://huggingface.co/openbmb/MiniCPM-V-4.7-1B)
|
||||
|
||||
Reference in new issue
Block a user