Patrick Devine 2e640e0933 mlx: add Gemma4 MTP support ...

This change adds support for MTP (multi-token prediction) speculative decoding for the
gemma4 model family.

It includes:
  * support for importing safetensors based gemma4 draft models with `ollama create`
  * a new DRAFT command in the Modelfile for specifying draft models
  * a --quantize-draft flag for the ollama create command to quantize the draft model
  * cache support for speculation
  * changes to the rotating cache to be able to handle MTP correctly
  * sampling support for draft model token prediction

2026-05-04 13:04:30 -07:00

..

testdata/fuzz/FuzzName

types/model: overhaul Name and Digest types (#3924)

2024-04-26 13:08:32 -07:00

capability.go

Add support for gemma4 (#15214)

2026-04-02 11:33:33 -07:00

config.go

mlx: add Gemma4 MTP support

2026-05-04 13:04:30 -07:00

name_test.go

Clean up the manifest and modelpath (#13807)

2026-01-21 11:46:17 -08:00

name.go

Clean up the manifest and modelpath (#13807)

2026-01-21 11:46:17 -08:00