AINewsnow

Multilingual Tiny (3.7B) Reasoning MoE pretrained from scratch on a consumer-grade GPU

This story is from 2026-09-01. It is preserved in the archive; the latest stories are on the live feed.

Hello! I've just uploaded a recent checkpoint of my model trained from scratch: https://huggingface.co/piotr-ai/polanka_3.7b_exp_wip_260901 It was pre-trained, mid-trained, and fine-tuned on a single 4090 over many months. How many tokens? I lost count. Feel free to use it as a research artefact. 1…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-01 15:26 · r/LocalLLaMA
    Multilingual Tiny (3.7B) Reasoning MoE pretrained from scratch on a consumer-grade GPU

More stories

  1. Qwen Image 2.1 PR to ComfyUI — r/StableDiffusion
  2. we made a 27b model for creative writing. performs as good as claude fable 5, at a 40x cheaper price, open weights. — r/GeminiAI
  3. Deploy Hugging Face models on Amazon SageMaker AI with coding agents — AWS Machine Learning Blog
  4. A quick Minimax H3 news round-up - 18th September 2026 — r/comfyui
  5. Change the camera movement/angle for your existing video clip - Minimax H3 V2V CrossView-Warp LoRA — r/StableDiffusion
  6. Hugging Face Hack Shows Humans Can Keep AI In Check — AI Now Institute
  7. Qwen/Qwen-Image-2.1 · Hugging Face — r/StableDiffusion
  8. this looks promising: stepfun-ai/Step-5-Preview-BF16 · Hugging Face — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →