mirror of
https://github.com/exo-explore/exo.git
synced 2026-01-24 13:59:48 -05:00
## Motivation Enable distributed image generation across exo clusters ## Changes - Added OpenAI-compatible /v1/images/generations and /v1/images/edits API endpoints - Added /bench/images/generations and /bench/images/edits endpoints that return generation statistics (timing, throughput metrics) - Implemented PipeFusion distributed inference for diffusion models, enabling patch-based parallelism across nodes - Added model adapters for Flux (schnell, dev) and Qwen image models ## Why It Works https://arxiv.org/abs/2405.14430 ## Test Plan ### Manual Testing - Generate images using /v1/images/generations endpoint with single and multi-node clusters - Test image editing via /v1/images/edits with source images - Verify streaming partial images appear progressively in the dashboard - Use /bench/images/generations to measure generation performance - Test both Flux and Qwen model families --------- Co-authored-by: Sami Khan <smsak99@gmail.com>