LocalAI · ds4 layer split

Workers dial in

LAYER

split

ds4 workers connect to the coordinator (llama.cpp RPC dials the other direction).

localai.io/features/distributed-mode