AINewsnow

vLLM Tool Calling Not Working? 1 in 12 Calls Fail by Default. Here's the Fix

This story is from 2026-10-27. It is preserved in the archive; the latest stories are on the live feed.

If your vLLM tool calling is not working with Kimi or DeepSeek, and your agent keeps emitting broken JSON, inventing arguments or looping on the same call, check your server before you blame the model. Ubicloud measured Kimi K2.6 on vLLM 0.28 and got schema-valid tool calls only 92% of the time . T…

Read the full story at DEV Community — AI ↗

Timeline · 1 report

  1. 2026-10-27 15:10 · DEV Community — AI
    vLLM Tool Calling Not Working? 1 in 12 Calls Fail by Default. Here's the Fix

More stories

  1. Moonshot apologises after Kimi K3.1 Pro roll-out stumbles as promotional scrutiny widens — South China Morning Post Tech
  2. AI news of the week — r/ArtificialInteligence
  3. Context Bombs: Making attacking agents pay — r/ArtificialInteligence
  4. I need to fine tune Qwen3.5-9B with QLora on about 500 GB of raw data (images/scanned documents/pdfs/word/excel) - what is the best way forward? — r/LocalLLaMA
  5. OpenAI and Anthropic support OSS maintainers. Do Chinese AI companies offer similar programs? — r/artificial
  6. Artificial Analysis Index is non-representative of real-world performance. Tested Kimi 3.1 Pro through OpenRouter, the number 4 model in AAI, it's not even close to MiMo 2.6 or DeepSeek 4.1 Flash — r/singularity
  7. I made a site to easily compare LLM benchmarks and costs in one place — r/LocalLLM
  8. Too good to be true? ISTA's GSQ-RCO 2-bit DeepSeek-V4.1-Flash scoring the same as the base model — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →