AINewsnow

I Trained a 757M-Parameter LLM From Scratch, Then Fine-Tuned Qwen Instead. Here's Everything I Learned.

Most "I built an LLM" posts show you a loss curve going down and stop there. This one is different, because my from-scratch model lost , and I think the why is the most useful thing I can teach you. Over the last few weeks I built two language models on the same task (empathetic, supportive dialogu…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-12 01:15 · DEV Community — Machine Learning
    I Trained a 757M-Parameter LLM From Scratch, Then Fine-Tuned Qwen Instead. Here's Everything I Learned.

More stories

  1. Qwen Image 2.1: exact type at native 2K on PixelDojo — DEV Community — Machine Learning
  2. SkillDuet (Qwen): Tracing Its Preceding Ideas and Technical Lineage | Qwen SkillDuet：原理与思想脉络溯源 — DEV Community — Machine Learning
  3. How to Deploy DeepSeek-R1 & Qwen on Azure with Scale-to-Zero ($0 Idle Bill) — DEV Community — AI
  4. How long are we gonna depend bunch of model creators (like Qwen, Gemma, NVIDIA, etc.,) for ~100B models? — r/LocalLLaMA
  5. Sam Altman wants my RAM. Sorry, my 2-bit Qwen needs it to teach my AI waifu how to bend her knees. — r/LocalLLM
  6. sensenova/SenseNova-Loop-9B-Preview · Hugging Face — r/LocalLLaMA
  7. Can open-weight LLMs can predict the effects of weight edits without running the model (9B–30B) — r/LocalLLaMA
  8. Crazy there's a probable connection between my desktop running Qwen 3.8 27B and a major geo-economic-political event — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →