From c498930fa1e802993c5da1ddc7ea6b208e9c6d8b Mon Sep 17 00:00:00 2001 From: DevEmilio96 Date: Tue, 1 Oct 2024 11:41:03 +0200 Subject: [PATCH] Hardware Requirement notes --- README.md | 2 ++ 1 file changed, 2 insertions(+) diff --git a/README.md b/README.md index 0427fe0f..f99713eb 100644 --- a/README.md +++ b/README.md @@ -90,6 +90,8 @@ The current recommended way to install exo is from source. **Note**: - For **MLX**, you can currently run **smaller models** such as **Llama-3.2-1B**, which are optimized for Apple Silicon hardware. - For **TinyGrad**, the **smallest model** currently supported is **Llama-3.1-8B**, which requires more robust hardware to run effectively. +- **Hardware requirements are indicative**: The overall load is distributed across the **CPU, RAM**, and **GPU/VRAM**, not solely on the GPU. Therefore, your system's performance depends on its ability to handle this distribution effectively. +- It is also **possible to run models in a cluster mode**, utilizing multiple devices to distribute the computation load across multiple machines or GPUs, enhancing performance. ### From source