AINewsnow

llama-server's Anthropic API ignores tool_choice and stops inside reasoning

This story is from 2026-10-20. It is preserved in the archive; the latest stories are on the live feed.

TL;DR : llama-server's Anthropic-compatible /v1/messages endpoint accepts two request controls and doesn't apply them. A forced tool, tool_choice: {"type": "tool", "name": "get_time"} , is treated as "call some tool": with get_weather and get_time available and a weather question, the model called…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-20 07:26 · DEV Community — AI
    llama-server's Anthropic API ignores tool_choice and stops inside reasoning

More stories

  1. Arc Pro B60 runs a 27B coding model at 53 tok/s: full recipe, flags and raw logs — r/LocalLLM
  2. Qwen 27B (IQ4_XS, Q8/Q4 KV) at full 262k context on a 16GB RX 9070 XT: 80+ t/s decode with Adaptive KV Streaming — r/LocalLLaMA
  3. Meta Says Claude AI Tool Triggered No Kings Instagram Suspension — r/artificial
  4. 12GB VRAM + 16GB RAM is enough for very smart local AI with 120K+ context — r/LocalLLM
  5. Qwen3-4B in 1.24 GB at perplexity 16.6 (IQ2_XXS at the same size: 28.6) - a tiny 8-state trellis quant for llama.cpp — r/LocalLLM
  6. Gemini feels miles behind in real-world agentic tasks (Why can't it do what other agents do?) — r/Bard
  7. WHIRL 0.2.0 now runs on the AMD Ryzen AI Max+ 395 (Radeon 8060S): native Windows LLM engine, faster than llama.cpp ROCm and Vulkan from 2k to ~250k tokens (also on the Radeon AI PRO R9700) — r/LocalLLM
  8. llama.cpp support for Cohere models — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →