AINewsnow

if you're on Strata before 0.1.45 and your client doesn't set sampling, you're running greedy

Two things I ran into while moving my Strata setup from IQ2_XS to Unsloth's UD-IQ4_XS (RTX 4090, i9-14900K, 64GB DDR5-5800, Arch). 1. Greedy sampling on older builds Before Strata 0.1.45, a run config without a `sampling` block decoded greedy whenever the request didn't set its own temperature. Gre…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-17 21:34 · r/LocalLLaMA
    if you're on Strata before 0.1.45 and your client doesn't set sampling, you're running greedy

More stories

  1. DeepSeek releases V4.1-Flash-1017 open-weight model under MIT license — Vercel Blog
  2. NVIDIA RTX Spark Laptops Launch Globally With Local AI Agent Support — NVIDIA Blog
  3. Meta releases 816B-parameter Muse Spark Open model for local Mac deployment — NVIDIA Blog
  4. OpenMOSS Releases Apache-Licensed MOSS-Image Model — r/StableDiffusion
  5. Community debates Qwen 3.8 Flash Next performance and optimization — r/LocalLLaMA
  6. NVIDIA RTX Spark Laptops Launch with Blackwell Graphics and AI Platform — NVIDIA Blog
  7. Vercel Adds Session Affinity to AI Gateway Logs — Vercel Blog
  8. Meta Removes AI Training Language from Terms After Backlash — The Verge AI

Get the daily brief of stories like this at 6:30 every morning →