AINewsnow

Self-hosting Qwen3.8-Flash-Next (or a smaller alternative) for a heavy multi-agent Hermes setup on $10k of AWS credits, looking for options I've missed

This story is from 2026-10-04. It is preserved in the archive; the latest stories are on the live feed.

I run a Kanban-driven multi-agent orchestrator on Hermes Agent: 20+ profiles, 1,000+ skills, MCP routing, and self-hosted Mem0 on pgvector. On Fireworks, I was doing roughly 9-15B tokens a month with a 90-98% cache hit rate, at about 30-60 Kanban tasks a day. I now want to move this to infrastructu…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-04 11:24 · r/LocalLLM
    Self-hosting Qwen3.8-Flash-Next (or a smaller alternative) for a heavy multi-agent Hermes setup on $10k of AWS credits, looking for options I've missed

More stories

  1. AWS expands SageMaker AI with data preparation tools and cross-Region inference routing — AWS Machine Learning Blog
  2. AWS expands SageMaker JumpStart with OpenTSLM, model leaderboard, and PolyAI Dialog-RSN-1 — AWS Machine Learning Blog
  3. How Duco transforms financial data automation with Amazon Bedrock AgentCore — AWS Machine Learning Blog
  4. AWS Adds Managed NVIDIA Dynamo Support to SageMaker HyperPod Inference — AWS Machine Learning Blog
  5. Amazon Polly launches generally available voice cloning for custom brand voices — AWS Machine Learning Blog
  6. Amazon and Alphabet to Hold Over 28% of Anthropic After Its IPO — The Globe and Mail
  7. Satya Nadella says AI agents will reshuffle the economics of the web — TechCrunch AI
  8. Disney and AWS unveil AI-powered Star Wars audio-animatronics — CNET AI

Read the Daily Brief: the day's most important AI stories →