I pre-trained a 1.11B LLM on my 6 GB laptop GPU. Peak VRAM: 4.51 GB.
Not fine-tuning. Not inference. Pre-training from scratch. Full write-up: https://huggingface.co/blog/RitishReal/1b-petrain-llm-in-4gb-vram
Read the full story at r/huggingface ↗
Timeline · 2 reports
- 2026-09-27 00:47 · r/huggingface
I pre-trained a 1.11B LLM on my 6 GB laptop GPU. Peak VRAM: 4.51 GB. - 2026-09-26 15:27 · r/LocalLLM
I pre-trained a 1.11B LLM on my 6 GB laptop GPU. Peak VRAM: 4.51 GB.