DePEFT: Crowdsourcing LLM training/fine-tuning without a centralized cloud.
This story is from 2026-09-10. It is preserved in the archive; the latest stories are on the live feed.
A while ago, I successfully trained a tiny 80M parameter language model from scratch using the TinyStories dataset. It worked surprisingly well and could generate coherent little stories! Inspired by that success, I wanted to scale up and train a larger model capable of coding. That’s when reality…
Read the full story at r/deeplearning ↗
Timeline · 1 report
- 2026-09-10 05:39 · r/deeplearning
DePEFT: Crowdsourcing LLM training/fine-tuning without a centralized cloud.