Pretraining From Scratch on an Inference-Only NPU: VKORE-46M-NPU
TL;DR: VIDRAFT pretrained a small language model from scratch on an inference-only NPU, running real backpropagation on a chip the industry considers inference-only. The result, VKORE-46M-NPU , is published on Hugging Face with weights, a model card, and comparison data. Trained under identical con…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-14 05:49 · DEV Community — Machine Learning
Pretraining From Scratch on an Inference-Only NPU: VKORE-46M-NPU