AINewsnow

Are there any tiny models that can do tool calls somewhat consistently?

I'm doing some work on a harness, and I want to have a tiny, low-cost test model I can run just to validate that the harness features are working correctly. Quality of output doesn't really matter at all, but I'm looking for something small that will run in a few GB of vram (context and quant can b…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-31 19:22 · r/LocalLLM
    Are there any tiny models that can do tool calls somewhat consistently?

More stories

  1. Anthropic files paperwork for IPO as investors weigh funds and credit outlook — New York Times Technology
  2. Mistral releases weights for trillion-parameter Le Chonk model with 1M-token context — Wired AI
  3. Big Tech sheds nearly $900bn as AI spending fears trigger market rout — Financial Times AI
  4. OpenAI cuts fundraising target to $20 billion amid AI market selloff — Financial Times AI
  5. Apple CEO John Ternus says company won't ship AI for AI's sake — Techmeme
  6. OpenAI, Google, Microsoft and Anthropic to honor unified AI training opt-out in robots.txt — OpenAI News
  7. Tampered Claude Code extension with SSH backdoor reached up to 5,000 Cursor users — Microsoft Research Blog
  8. OpenAI tightens ChatGPT limits on weapons information for teen users — Reuters AI

Get the daily brief of stories like this at 6:30 every morning →