exo

exo is open-source local AI inference cluster software that connects Macs and workstations, discovers devices, splits models across memory, and serves standard APIs for running AI locally.