AINewsnow

You can now train your own LLMs with less memory, on your gaming GPUs

TL;DR: You can train your own 27B model on a 3090 with 24GB VRAM, though you would have to go through hundreds of billions of tokens for it to be good. I am working on conversion of existing models. Check repos for code and the paper if you are interested in more. I have a 40.4GB Qwen Flash Next GG…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-11-11 12:36 · r/LocalLLaMA
    You can now train your own LLMs with less memory, on your gaming GPUs

More stories

  1. GPT-6 Astra edits a small model’s weights, pointing to AI debugging — DEV Community — Machine Learning
  2. Abliteration technique removes safety filters from local open-weight AI models — InfoWorld AI
  3. RustingStrata vs llama.cpp runs DeepSeek-V4.1-Flash Q2 (249 GB) on a single RTX 3060 12 GB with 30 GB RAM — r/LocalLLM
  4. Qwen 3.8 27B: Run It Locally on One GPU with LM Studio — DEV Community — Machine Learning
  5. KQuant - new quantization technique, 3.7× better quants for Qwen Flash Next 180B, Qwen 27B, 35B, 9B (measured in KL-divergence reduction) (MLX) — r/LocalLLaMA
  6. Amazing... Every Word You Just Said Was Wrong. — DEV Community — AI
  7. I fine-tuned Qwen 2.5 (3B) with Unsloth to build CyberAgent: An offline AI security agent with 57 tools — DEV Community — AI
  8. Qwen 3.6 27b is "degenerate" in layer 3 of the J-space — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →