Exo by exo labs allows you to create your AI cluster using everyday devices like iPhones, iPads, Android devices, and more. It optimally splits models across devices, allowing you to run larger models than on a single device. Exo connects devices peer-to-peer, enabling any connected device to run models. The software is experimental, with bugs expected, but the team is working to resolve issues quickly. Installation is straightforward, and exo provides a ChatGPT-compatible API. The platform supports various inference engines and networking modules, although there are known issues with the iOS implementation lagging behind Python.
https://github.com/exo-explore/exo