2075 Commits

This Branch

This Branch

All Branches

Author	SHA1	Message	Date
ciaranbor	3bcdd46bb1	Add adaptor registry	2026-01-20 16:07:56 +00:00
ciaranbor	46181a35ae	Remove mflux/generator/generate.py	2026-01-20 16:07:56 +00:00
ciaranbor	e29d0b4a0e	Switch to using DistributedImageModel	2026-01-20 16:07:56 +00:00
ciaranbor	633147cb02	Add DistributedImageModel	2026-01-20 16:07:56 +00:00
ciaranbor	3f5b4a43db	Use new generic wrappers, etc in denoising	2026-01-20 16:07:56 +00:00
ciaranbor	9ee7a3e92b	Add generic transformer block wrappers	2026-01-20 16:07:56 +00:00
ciaranbor	3e40b2beb5	Add FluxAdaptor	2026-01-20 16:07:56 +00:00
ciaranbor	4d6f339e6f	Add ModelAdaptor, derivations implement model specific logic	2026-01-20 16:07:56 +00:00
ciaranbor	282b63effb	Introduce image model config concept	2026-01-20 16:07:56 +00:00
ciaranbor	cb537b0110	Consolidate kv cache patching	2026-01-20 16:07:56 +00:00
ciaranbor	afc1643eb2	Support different configuration comms	2026-01-20 16:07:56 +00:00
ciaranbor	02ca7d5a4b	Add ImageGenerator protocol	2026-01-20 16:07:56 +00:00
ciaranbor	73abda4f17	Force final patch receive order	2026-01-20 16:07:56 +00:00
ciaranbor	f492fd4be8	Remove logs	2026-01-20 16:07:56 +00:00
ciaranbor	e59b51788b	Update patch list	2026-01-20 16:07:56 +00:00
ciaranbor	f1b08bdf68	Slight refactor	2026-01-20 16:07:56 +00:00
ciaranbor	1e74c5ec4f	Don't need array for prev patches	2026-01-20 16:07:56 +00:00
ciaranbor	839e845876	Fix send/recv order	2026-01-20 16:07:56 +00:00
ciaranbor	8ab312de44	Fix async single transformer block	2026-01-20 16:07:56 +00:00
ciaranbor	9e0d646505	Use relative rank variables	2026-01-20 16:07:56 +00:00
ciaranbor	6a21dca2e0	Fix writing patches	2026-01-20 16:07:56 +00:00
ciaranbor	b491607a8f	Collect final image	2026-01-20 16:07:56 +00:00
ciaranbor	258754a5e8	Fix recv_template shape	2026-01-20 16:07:56 +00:00
ciaranbor	09ec079be8	Add logs	2026-01-20 16:07:56 +00:00
ciaranbor	3da22204db	Optimise async pipeline	2026-01-20 16:07:56 +00:00
ciaranbor	60d7ea6265	Add next_rank and prev_rank members	2026-01-20 16:07:56 +00:00
ciaranbor	f37751b31f	Add _create_patches method	2026-01-20 16:07:56 +00:00
ciaranbor	0f357e1f9b	Fix shapes	2026-01-20 16:07:56 +00:00
ciaranbor	9b0a621987	Reorder comms	2026-01-20 16:07:56 +00:00
ciaranbor	5574eb57e5	Remove all_gather from sync pipeline, send from final rank to first rank	2026-01-20 16:07:56 +00:00
ciaranbor	ddc67f09cc	Simplify kv_cache initialization	2026-01-20 16:07:56 +00:00
ciaranbor	27b343316b	Fix kv cache	2026-01-20 16:07:56 +00:00
ciaranbor	99705175ee	Clean up kv caches	2026-01-20 16:07:56 +00:00
ciaranbor	8aad72b4d7	Fix return	2026-01-20 16:07:56 +00:00
ciaranbor	2ce3833b17	Fix hidden_states shapes	2026-01-20 16:07:56 +00:00
ciaranbor	ac535d5725	Only perform projection and scheduler step on last rank	2026-01-20 16:07:56 +00:00
ciaranbor	9dae2eafd4	Only compute embeddings on rank 0	2026-01-20 16:07:56 +00:00
ciaranbor	d082db113d	Remove eval	2026-01-20 16:07:56 +00:00
ciaranbor	48298104a8	Remove eval	2026-01-20 16:07:56 +00:00
ciaranbor	49823aa6d5	Only send encoder_hidden_states with the first patch (once per timestep)	2026-01-20 16:07:56 +00:00
ciaranbor	76eb5171f4	Remove redundant text kv cache computation	2026-01-20 16:07:56 +00:00
ciaranbor	7fa8ebacad	Concatenate before all gather	2026-01-20 16:07:56 +00:00
ciaranbor	cebd3de003	Increase number of sync steps	2026-01-20 16:07:56 +00:00
ciaranbor	e6cd1291b9	Reinitialise kv_caches between generations	2026-01-20 16:07:56 +00:00
ciaranbor	52d9e77bed	Eliminate double kv cache computation	2026-01-20 16:07:56 +00:00
ciaranbor	3d41745b51	Add kv cache caching wrappers for sync pipeline transformer blocks	2026-01-20 16:07:56 +00:00
ciaranbor	c5c3f43c6c	Persist kv caches	2026-01-20 16:07:56 +00:00
ciaranbor	8ac0686125	Implement naive async pipeline implementation	2026-01-20 16:07:56 +00:00
ciaranbor	4d8a759eb2	Use wrapper classes for patched transformer logic	2026-01-20 16:07:56 +00:00
ciaranbor	5d7c0847c1	Add patch-aware joint and single attention wrappers	2026-01-20 16:07:56 +00:00