Machine-learning software can tailor calculations to a graphics processing unit (GPU), but data sent between GPUs often goes through general-purpose libraries. Their communication code cannot be optimized together with the calculations, adding overhead.
Obaleth is a compiler, software that turns a program into machine instructions. It puts data transfers into the same intermediate representation (IR), a structured plan the compiler can inspect, as calculations. It can group transfers, schedule them around buffer use, and skip synchronization steps when safe.
Obaleth sends small messages up to 3.3 times faster and answered requests up to 1.29 times faster in a language-model serving test. Faster communication can improve overall service speed, not just the transfer itself.
