AINewsnow

I tested Qwen3.8 27B IQ3_XXS (10.18GiB) vs Bonsai Ternary PQ2 (6.42GiB)

I did a small test of the new hyped quantisation of Qwen3.8 vs the biggest quant which fits into my limited 16GB VRAM with decent context. The results are interesting. Of course, the smaller file gives worse results. However they are not that far off. Unfortunately, this comes at the expense of eve…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-09-19 15:12 · r/LocalLLaMA
    I tested Qwen3.8 27B IQ3_XXS (10.18GiB) vs Bonsai Ternary PQ2 (6.42GiB)

More stories

  1. Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
  2. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  3. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
  4. NVIDIA CEO Jensen Huang rejects ‘AI will end the world’ claim, yet cautions ‘we should go as fast as we can but...’ — Mint AI
  5. Meet the Data Agent in ChatGPT Work — OpenAI YouTube
  6. AI hallucination of Chinese nuclear components almost led to US military attack — Ars Technica AI
  7. TypeSafe AI Releases Jev: A System One Model That Returns Typed, Calibrated Decisions Instead of Text — MarkTechPost
  8. AI's role in building AI surging? Anthropic says Claude now leads 26% of its R&D — Mint AI

Get the daily brief of stories like this at 6:30 every morning →