AINewsnow

What is the best AI model and quantization to run the Hermes agent comfortably on 16GB VRAM?

This story is from 2026-09-10. It is preserved in the archive; the latest stories are on the live feed.

I want to try running scheduled tasks using local AI models in Hermes. Which AI model is best to use in the Hermes agent? How do you handle context, and what quantization techniques should be used to run it comfortably on 16GB VRAM?

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-10 15:08 · r/LocalLLM
    What is the best AI model and quantization to run the Hermes agent comfortably on 16GB VRAM?

More stories

  1. Anthropic, OpenAI, SpaceXAI, Google sued over call to ‘pace’ AI development — Politico Technology
  2. Introducing Kimi K3 on Amazon Bedrock — AWS Machine Learning Blog
  3. Introducing Amazon SageMaker HyperPod Inference Gateway — AWS Machine Learning Blog
  4. Google's Gemini AI hacks three other companies during security test — Sky News Technology
  5. Gemini Hacked Three Companies in First Known Breakout by Google’s AI — Wall Street Journal Technology
  6. AI's role in building AI surging? Anthropic says Claude now leads 26% of its R&D — Mint AI
  7. Cactus Needle 3: A Sliceable 8-29MB Automation Foundation Model That Matches DeepSeek v4 Flash — r/LocalLLaMA
  8. Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →