Hivemind

Hivemind is an open-source PyTorch library for decentralized deep learning across the Internet, intended for training large neural networks on many heterogeneous computers from universities, companies, and volunteers.