AINewsnow

QLoRA on ExLlamaV3 Quants - Train @ 2-8bpw

EXL3-QLoRA I've built this over the last few months and I think it's stable enough to share now. A fork of ExLlamaV3 , this is a native ExLlamaV3 training implementation with plain PyTorch, without transformers. exl3-qlora on github Why? With it, you can train 2-8bpw exl3 quantized models, rather t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-12 07:30 · r/LocalLLaMA
    QLoRA on ExLlamaV3 Quants - Train @ 2-8bpw

More stories

  1. Microsoft CEO Nadella calls for AI 'emergency brake' and trust architecture review — CNBC Technology
  2. Nvidia in talks to acquire US ‘open’ model start-up Reflection AI — Financial Times AI
  3. Qwen Image 2.1 Turbo and MiniMax H3 Gain Community Support — r/StableDiffusion
  4. Microsoft president calls for global AI regulation, citing lack of oversight — BBC Technology
  5. Former HSBC executive launches AI-driven wealth management startup — South China Morning Post Tech
  6. Ex-DeepMind scientist David Silver launches startup Ineffable Intelligence — Financial Times AI
  7. Centre for the Governance of AI Announces 2027 Winter Fellowships — Centre for the Governance of AI
  8. Qualcomm CEO Says AI Firms Seek 100B-Parameter Models on Phones by 2028 — Techmeme

Get the daily brief of stories like this at 6:30 every morning →