vprojectx/Lewis-44M-Bert-V3 · Hugging Face
I trained a BERT-style language model from scratch on ONE laptop GPU. Lewis-44M-Bert-V3: small, fast, open source (Apache-2.0). HOW IT WAS BUILT • 44M parameters, ELECTRA-style pre-training • 2.7B tokens in ~22 hours on a single RTX 5050 (8 GB) • ~53 GPU-hours across all three versions, no cloud cl…
Read the full story at r/deeplearning ↗
Timeline · 2 reports
- 2026-10-29 19:51 · r/learnmachinelearning
vprojectx/Lewis-44M-Bert-V3 · Hugging Face - 2026-10-29 19:49 · r/deeplearning
vprojectx/Lewis-44M-Bert-V3 · Hugging Face