AINewsnow

Made a really good Qwen3.8 27B 16GB setup, no strata/streaming-kv

I wanted to share my setup thats working really well for my fellow 16GB desktop suffrage crew. I am able to get 110k context with ~1.5GB to spare and around 55 t/s on my 5070 TI. First off I found this model https://huggingface.co/hitsfmdj/Qwen3.8-27B-GGUF-4.2BPW-16GB with custom weights that seems…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-30 22:29 · r/LocalLLaMA
    Made a really good Qwen3.8 27B 16GB setup, no strata/streaming-kv

More stories

  1. DOJ scrutinizes Nvidia's $12.93 billion acquisition of Hugging Face — Mint AI
  2. Hugging Face Official Benchmarks: Daily Update 2026-11-01 — DEV Community — AI
  3. 1,200 AI Agents Escaped Their Sandbox and Hacked Hugging Face to Cheat a Test. Then It Happened Again. — DEV Community — AI
  4. SWE-Bench Pro Has Two Versions: What the Hugging Face Leaderboard's 47 Rows Mix Together — DEV Community — AI
  5. Glitch-Img-1.0: RGBA Image Generation & Editing with Qwen-Image-2.1 — DEV Community — Machine Learning
  6. MasryGPT-Chat-1.5B: Teaching Qwen2.5 to Speak Egyptian Arabic (Masry) — DEV Community — Machine Learning
  7. I added Hugging Face model downloads to my free, open-source download manager: it picks the quant, queues the files, resumes after crashes and checks SHA-256 — r/huggingface
  8. Spark-X2.6-4B DSpark Is Here: More Than 2x Average BF16 Inference Speed — DEV Community — Machine Learning

Get the daily brief of stories like this at 6:30 every morning →