mirror/ollama
1
0
Fork 0
mirror of https://github.com/ollama/ollama.git synced 2026-02-20 00:05:06 -05:00
Code Issues Packages Projects Releases Wiki Activity
5,087 Commits 355 Branches 434 Tags
8a257ec00a76d3dd90f0106fba1e56215588efae
Commit Graph

2 Commits

Author SHA1 Message Date
Patrick Devine
d18dcd7775 mlxrunner fixes (#14247) 
* load glm4_moe_lite from the mlxrunner

* fix loading diffusion models

* remove log lines

* fix --imagegen flag
 2026-02-13 22:30:42 -08:00
Patrick Devine
44bdd9a2ef Add MLX runner with GLM4-MoE-Lite model support (#14185) 
This change adds a new MLX based runner which includes:

  * Method-based MLX bindings
  * Subprocess-based MLX runner (x/mlxrunner)
  * KV cache with tree management
  * A basic sampler

The GLM4-MoE-Lite model has been ported to use the new bindings.

---------

Co-authored-by: Michael Yang <git@mxy.ng>
 2026-02-10 14:57:57 -08:00