Hello I'm creating CrowdGPT, an open-source project which allows training of a LLM (Large Language Model) in a decentralized way, where each user contributes to making the AI better with whatever data they want.
The idea is simple: instead of one machine owning the entire training run, let many people contribute small training jobs and periodically merge those updates into a shared model.
The system is based on a centralized server (lightweight) that receives every client training, then "merge them back" to the main model. This system prevents threats or malicious updates by doing cross-client verifications (provides a proof of work).
The users that train the model are being put on a leaderboard, rewarding their contribution.
Data is taken from a curated dataset on Hugging Face (which means no personal data is ever used during training). However, users can push new text to this dataset (which is then moderated and validated).
If you're curious, here is the GitHub: https://github.com/Vxtzq/CrowdGPT
Here is the website: https://www.crowdgpt.net
The best way to help me is to either:
- Give feedback on what must be changed to make it a fully finished project. I'm mainly looking for criticism: what would stop you from running this on your own GPU?
- Contribute to the project by becoming a part of the network (coming soon)
- Star the repo on GitHub ⭐ It helps a lot :)
