mirror/exo
1
0
Fork 0
mirror of https://github.com/exo-explore/exo.git synced 2026-04-23 23:39:53 -04:00
Code Issues Packages Projects Releases Wiki Activity
Files
distributed-settings
exo/resources/inference_model_cards
History
rltakashige fcc3718efb Add sampling defaults (#1947) 
## Motivation

Model quality issues

### Manual Testing
TODO
2026-04-21 06:45:33 +00:00
..
mlx-community--DeepSeek-V3.1-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--DeepSeek-V3.1-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--DeepSeek-V3.2-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--DeepSeek-V3.2-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-26b-a4b-it-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-26b-a4b-it-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-26b-a4b-it-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-26b-a4b-it-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-31b-it-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-31b-it-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-31b-it-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-31b-it-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e2b-it-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e2b-it-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e2b-it-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e2b-it-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e4b-it-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e4b-it-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e4b-it-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gemma-4-e4b-it-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.5-Air-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.5-Air-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-8bit-gs32.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-Flash-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-Flash-5bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-Flash-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-4.7-Flash-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-5-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-5-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--GLM-5-MXFP4-Q8.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gpt-oss-20b-MXFP4-Q8.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--gpt-oss-120b-MXFP4-Q8.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Kimi-K2-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Kimi-K2-Thinking.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Kimi-K2.5.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--llama-3.3-70b-instruct-fp16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-70B-Instruct-HF-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-70B-Instruct-HF-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-70B-Instruct-HF-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-Nano-4B-v1.1-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-Nano-4B-v1.1-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.1-Nemotron-Nano-4B-v1.1-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.2-1B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.2-3B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.2-3B-Instruct-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.3-70B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Llama-3.3-70B-Instruct-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Meta-Llama-3.1-8B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Meta-Llama-3.1-8B-Instruct-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Meta-Llama-3.1-8B-Instruct-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Meta-Llama-3.1-70B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.1-3bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.1-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.5-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.5-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.5-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7-4bit-mxfp4.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7-5bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--MiniMax-M2.7.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-4Bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-5Bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-6Bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-8Bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-BF16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-MLX-MXFP4.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-3-Nano-30B-A3B-NVFP4.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-Nano-9B-v2-4bits.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--NVIDIA-Nemotron-Nano-9B-v2-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-0.6B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-0.6B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-30B-A3B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-30B-A3B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-235B-A22B-Instruct-2507-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-235B-A22B-Instruct-2507-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-480B-A35B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-480B-A35B-Instruct-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-Next-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-Next-5bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-Next-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-Next-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Coder-Next-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Next-80B-A3B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Next-80B-A3B-Instruct-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Next-80B-A3B-Thinking-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-Next-80B-A3B-Thinking-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3-VL-4B-Instruct-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-2B-MLX-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-9B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-9B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-27B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-27B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-35B-A3B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-35B-A3B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-122B-A10B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-122B-A10B-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-122B-A10B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-122B-A10B-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-397B-A17B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-397B-A17B-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.5-397B-A17B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.6-35B-A3B-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.6-35B-A3B-5bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.6-35B-A3B-8bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Qwen3.6-35B-A3B-bf16.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Step-3.5-Flash-4bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Step-3.5-Flash-6bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00
mlx-community--Step-3.5-Flash-8Bit.toml
Add sampling defaults (#1947)
2026-04-21 06:45:33 +00:00