AINewsnow

llama-server's Responses API marks truncated replies and tool calls as completed

This story is from 2026-10-20. It is preserved in the archive; the latest stories are on the live feed.

TL;DR : llama-server's OpenAI-compatible /v1/responses endpoint never reports a reply as cut off. On llama.cpp b11753, a request with max_output_tokens: 8 came back with "status": "completed" , incomplete_details: null and the text 1 2 3 4 , stopped mid-count. A tool call cut off by the limit came…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-20 22:41 · DEV Community — AI
    llama-server's Responses API marks truncated replies and tool calls as completed

More stories

  1. DeepSeek V4.1 Flash is now available in Token Pass — Vercel Blog
  2. Qwen3.8-Flash-Next 125B Q2_0 on a 24GB M4 Mac mini: ~8.1 tok/s with Strata — r/LocalLLM
  3. Intel Arc B580 now beats an RTX 5060 Ti on llama.cpp prompt processing (Llama 2 7B), plus 1.5x faster long chats — r/LocalLLM
  4. Qwen3.6-35B-A3B (22 GB, 4-bit) on a 16 GB Mac mini M4 through stock llama.cpp: speed, a 4-agent crew, and executed code scores — r/LocalLLM
  5. Why AI Companies Are Betting Personality Beats Intelligence — The AI Daily Brief
  6. I let agents plan a WNBA Finals trip (but kept my wallet to myself) — Axios AI+
  7. Geezuz kernel: Qwen3.8-27B at 190 tok/s (620~ tok/s at 8 requests) on two 3090s — r/LocalLLaMA
  8. I’m having Claude and ChatGPT compete — r/ClaudeAI

Get the daily brief of stories like this at 6:30 every morning →