AINewsnow

Qwen 3.8 25B on 5060TI with 100k+ context

Hello everyone! After much back and forth with various models, I have now found the optimum for my use case on a single 16GB RTX 5060Ti: Qwen 27B IQ3xxs with MTP . Maybe the setup will be useful to someone else too! Since the 16GB VRAM is very tight here, I used vocabulary pruning to remove charact…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-13 09:16 · r/LocalLLM
    Qwen 3.8 25B on 5060TI with 100k+ context

More stories

  1. Alibaba releases Qwen-Image-2.1-Turbo with 80% fewer generation steps — r/StableDiffusion
  2. Alibaba launches Qwen Glasses N1 and Qwen Clip AI earbuds — Techmeme
  3. Alibaba Prepares Qwen Go Personal AI Assistant for Task Automation — TechNode
  4. Alibaba starts selling its Qwen N1 AI glasses in China from $450 — The Next Web
  5. Users report Qwen 3.8 Flash Next performance on local hardware — r/LocalLLaMA
  6. 1080 + 1060 + 64gb ddr5 orca qwen 3.8 flash iq3_xxs in strata — r/LocalLLM
  7. Running decision models: Picking quant, VRAM usage — r/LocalLLaMA
  8. Do any local models come close to chatgpts ability to generate sample character images? (2nd image is original) — r/StableDiffusion

Get the daily brief of stories like this at 6:30 every morning →