Looking for a local model, under 5GB vram, only needs to handle formatting or script execution?
Title, looking for a local model I can run ideally 5GB (3 or 4) or less vram is even better that doesn't need a lot of reasoning logic, just needs to be able to handle formatting guidelines on already written code, or executing scripts as a sub-agent. Basically a sub-agent model a larger model can…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-09-29 15:56 · r/LocalLLM
Looking for a local model, under 5GB vram, only needs to handle formatting or script execution?
More stories
- NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring — NVIDIA Technical Blog
- How we found 24 Android vulnerabilities using our open source AI security agent — GitHub Blog
- OpenAI pauses AI training, launches ‘extensive’ review after multiple rogue agent incidents — Mint AI
- Anthropic warns of ‘existential risks to humanity’ in IPO prospectus — Financial Times AI
- Introducing Claude Sonnet 5.5 on AWS — AWS Machine Learning Blog
- OpenAI launches Dots, always-on agents powered by GPT-6 Astra with their own cloud computer, in ChatGPT for Pro, Business Premium, and Enterprise users (Rachel Metz/Bloomberg) — Techmeme
- OpenAI Scraps Release of New AI Model Over Safety Concerns — Wall Street Journal Technology
- OpenAI DevDay 2026: The biggest news and announcements — The Verge AI
Get the daily brief of stories like this at 6:30 every morning →