AINewsnow

Qwen3.8-27B in 12.06 GiB on a 16 GB card, benchmarks included

Yesterday I posted a 32B pack and the replies were interesting about it being old completely overlooking benchmarks. A lot of quants "fit" on 16 GB, obviously... Almost none of them post what it cost. A screenshot of a model loading is not a benchmark and neither is its tokens per second performanc…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-11-09 15:22 · r/LocalLLM
    Qwen3.8-27B in 12.06 GiB on a 16 GB card, benchmarks included

More stories

  1. Anthropic launches Claude Fable 5.2 and Mythos 5.2 models ahead of planned IPO — Anthropic (X)
  2. Nvidia opens probe into CEO Jensen Huang's affair with suspected Chinese spy — The Verge AI
  3. Meta releases Muse Ember, a small low-cost model for agent and coding work — TechCrunch AI
  4. Meta Expands AI Age Estimation Globally to Extend Instagram Teen Account Protections — Meta Newsroom
  5. Apple launches $50 'intelligence usage packs' for select AI features — The Verge AI
  6. Senator Urges Google to Let Schools Disable AI Features in Search — New York Times Technology
  7. Google Adds TPU 8tx and TPU 8i Max to Eighth-Generation Chip Lineup — Google: The Keyword
  8. ByteDance launches Seedream 5.5 image model with 100-round stable editing — DailyAI

Get the daily brief of stories like this at 6:30 every morning →