https://github.com/learning-at-home/hivemind

Python
Decentralized deep learning framework in pytorch. Built to train models on thousands of volunteers across the world.

Hivemind

A library to train large neural networks across the internet. Imagine training one huge transformer on thousands of computers from universities, companies, and volunteers.

Links:

• What is hivemind all about? Here's a 3-minute read or a full paper
• Quickstart tutorial - install hivemind, set up a server and train experts
• Documentation & guides: learning-at-home.readthedocs.io
• Want to contribute? take a look at the issues or join our chat room
• Developer's guide: best practices, tests and performance benchmarks
• Related projects and acknowledgements