AINewsnow

Dwarfstar quants

This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.

anyone try these out? https://dwarfstar.sh they have very clever quant techniques, bespoke for a handful of models running on their software. i got qwen 3.8 next running on m3 ultra 96GB studio and its fast and seems good so far. with memory headroom for other stuff kinda blown away to be honest. w…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-01 15:12 · r/LocalLLaMA
    Dwarfstar quants

More stories

  1. Weight-space programming is not autonomous self-improvement — DEV Community — Machine Learning
  2. ANT is going to see some crazy action when Qwen 4 releases. — r/LocalLLaMA
  3. First time trying FP16, wow — r/LocalLLM
  4. Basalt 0.4.0: More models, still as fast - Qwen 27B up to 770 tok/s on a 5090 — r/LocalLLaMA
  5. Qwen Image 2.1 Turbo: Eight Steps Against Twenty-Five, and Eight ControlNet Modes — DEV Community — AI
  6. FLUX.3 Klein Qwen 2.1: A Pose-and-Outfit Matrix Built From 1407 Garments and 1439 Pose Images — DEV Community — AI
  7. Running Llama 3.2 & Qwen 2.5 100% Offline in React Native & Expo 52: Solving Thermal Throttling, OOMs, and Background Streaming — DEV Community — AI
  8. [ Video ] Local AI: Running Alpie Seed on a 16GB MacBook Pro — DEV Community — AI

Get the daily brief of stories like this at 6:30 every morning →