AINewsnow

LLM JSON output: one setting dropped valid JSON from 75% to 4%

This story is from 2026-10-17. It is preserved in the archive; the latest stories are on the live feed.

Originally published at tensorust.com . TL;DR: On October 17, 2026 I asked three small language models for JSON 432 times , in a real Chrome tab, with the exact sampling settings my browser chat app ships. Llama 3.2 1B returned schema-valid JSON 75% of the time with plain greedy decoding. Turning o…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-17 20:31 · DEV Community — AI
    LLM JSON output: one setting dropped valid JSON from 75% to 4%

More stories

  1. User friendly GUI for configuring and launching llama.cpp — r/LocalLLM
  2. Academic history research agent on 16GB vRAM, context important — r/LocalLLM
  3. What model do you recommend for coding to this hardware? (LLama.cpp) — r/LocalLLM
  4. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLM
  5. WHIRL 0.2.0 now runs on the AMD Ryzen AI Max+ 395 (Radeon 8060S): native Windows LLM engine, faster than llama.cpp ROCm and Vulkan from 2k to ~250k tokens (also on the Radeon AI PRO R9700) — r/LocalLLM
  6. Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs — r/LocalLLM
  7. Unsloth's Llama 3.2 Mirror Hits 800K Downloads by Removing Meta's Login Wall — AlphaSignal
  8. V100 16GB: A 2017 GPU running a 35B vision model at 93 tok/s: Tesla V100 16 GB on Windows — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →