AINewsnow

6-7tk/s on qwen3.8-next-flash Q2_0 at 128k context on 8gb vram and 32gb ram worth it?

i got this thing badtheorylabs/Tinfield-1-Mini-GGUF running on my 8gb vram GPU and 32gb ddr5 ram, it is like a post trained qwen3.8 flash next, at q2 quant, really really bad KL btw (0.340 against q8) So it has like 34.7 GiB of total weights in experts and then around a ~35 gb ngram table, so all t…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-26 16:14 · r/LocalLLM
    6-7tk/s on qwen3.8-next-flash Q2_0 at 128k context on 8gb vram and 32gb ram worth it?

More stories

  1. Introducing Gemini 3.8 Live with Live Avatar — Google Gemini Blog
  2. Accelerating vision-language models with LFM2.5-VL-DSpark — Hugging Face Blog
  3. OpenAI’s A.I. Went Rogue and Meddled With U.S. Government Websites — New York Times AI
  4. GPT‑6 Sol and Luna: Cheaper, but Worse Where It Matters — r/OpenAI
  5. OpenAI agent ‘hacked’ Australian Govt Medicare portal, PM Albanese calls it ‘unacceptable’: What happened? — Mint AI
  6. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  7. Unsecured OpenAI agents posted 53 user images on the internet without the lab's knowledge — TechCrunch AI
  8. Appeals Court Lets the Pentagon Designate Anthropic a Supply-Chain Risk — Wired AI

Get the daily brief of stories like this at 6:30 every morning →