why is everyone still using cloud llms just to route tool calls? tested local cpu embeddings vs bm25 on 100k tools
honestly i dont get why current multi-agent setups are built like this. if you connect 4 or 5 mcp servers (github, postgres, filesystem, slack etc) you easily end up with 40-50+ tool schemas. right now the standard pattern in langchain or claude code is dumping all 4,000+ tokens of json schemas int…
Read the full story at r/AI_Agents ↗
Timeline · 1 report
- 2026-10-27 13:09 · r/AI_Agents
why is everyone still using cloud llms just to route tool calls? tested local cpu embeddings vs bm25 on 100k tools