AINewsnow

You can now train your own LLMs with less memory, on your gaming GPUs

TL;DR: You can train your own 27B model on a 3090 with 24GB VRAM, though you would have to go through hundreds of billions of tokens for it to be good. I am working on conversion of existing models. Check repos for code and the paper if you are interested in more. I have a 40.4GB Qwen Flash N ext G…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-09 14:43 · r/LocalLLM
    You can now train your own LLMs with less memory, on your gaming GPUs

More stories

  1. Anyone else feeling like Qwen4's release happens in slow-motion? — r/LocalLLaMA
  2. ConceptCountry/qwen-concept-27b · Hugging Face — r/LocalLLaMA
  3. Qwen Image 2.1 Texture inpaint and outpaint lora + custom_nodes for ComfyUI — r/StableDiffusion
  4. Qwen 3.8 testing. Part 3 of 3. "Use REA to make a game from a GBA ROM file" (playable web link inside) — r/LocalLLM
  5. EAGLE-3 Speculative Decoding in vLLM for Qwen3-30B-A3B-Instruct-2507 — DEV Community — Machine Learning
  6. AI Brief: Apple's HALO Robot, 5,000 Agents per Repo — DEV Community — AI
  7. How much of GPT-6 Astra's weight-editing demo is the harness? — DEV Community — Machine Learning
  8. L11 N8147 is a neuron that will make Qwen-3.5-4B get things confidently wrong while being weirdly snarky... But also makes it write interesting poetry — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →