I built a small Python library to add retries, caching, fallbacks, budgets, and guardrails around native LLM SDK calls
This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.
Hey everyone, I’ve been working on a small open-source Python library called callm and would genuinely love feedback from people using LLMs in production. The idea is simple: instead of replacing the OpenAI, Anthropic, or Google GenAI SDKs with another abstraction, it wraps the functions where you…
Read the full story at r/LocalLLM ↗