local subagents on a mac: three requests share one verify pass, +23% throughput on qwen3.8-27b
hey, im working on an open source project called kapitsa, an inference engine for macs. agent frameworks fire several model calls at once, subagents, tool calls, a planner. on a mac with one gpu those usually just queue. kapitsa runs speculative decoding as a tree, we call it kflash. a drafter gues…
Read the full story at r/AI_Agents ↗
Timeline · 1 report
- 2026-10-23 19:14 · r/AI_Agents
local subagents on a mac: three requests share one verify pass, +23% throughput on qwen3.8-27b