AINewsnow

Best Qwen3.8 27B variant for 16GB VRAM: Base vs. Swift 1.5 vs. Bonsai 2

TL;DR: Swift 1.5 IQ3_XXS at 112K context looks like the best all-round option for my needs on a 16GB RTX 5070 Ti. It nearly matched the base model on coding and scored higher on math. If you care more about speed and context, Bonsai 2 generated text about 1.9× faster and supported 256K context, but…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-03 05:10 · r/LocalLLM
    Best Qwen3.8 27B variant for 16GB VRAM: Base vs. Swift 1.5 vs. Bonsai 2

More stories

  1. NVIDIA DGX Spark 64GB Gives Developers More Ways to Build and Scale Local AI — NVIDIA Blog
  2. Gemini 4 Argon: our next era of frontier intelligence — Google Gemini Blog
  3. Guided Vision in Gemini Live: built for accessibility — Google Gemini Blog
  4. Google tests its plan for AI data centers in space with Project Suncatcher — Scientific American
  5. Google announces Gemini 4 Argon AI model, but you can't use it yet — Ars Technica AI
  6. OpenAI DevDay 2026 Keynote (FULL) — OpenAI YouTube
  7. The latest AI news we announced in September 2026 — Google Gemini Blog
  8. Introducing Olmo-core 3: Open, scalable training infrastructure for large MoEs — Allen Institute for AI (Ai2)

Get the daily brief of stories like this at 6:30 every morning →