I pre-trained a 1.11B LLM on my 6 GB laptop GPU. Peak VRAM: 4.51 GB.
Not fine-tuning. Not inference. Pre-training from scratch. Full write-up: https://huggingface.co/blog/RitishReal/1b-petrain-llm-in-4gb-vram
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-26 15:27 · r/LocalLLM
I pre-trained a 1.11B LLM on my 6 GB laptop GPU. Peak VRAM: 4.51 GB.