I built a LoRA router for Qwen3.5 9B as an experiment: it picks a domain expert for every message
Processing img h3pfo3vgxsxh1... I wanted to run a stronger model on my Mac, but with 16 GB of unified memory the big ones just don’t fit. So, as an experiment, I tried the opposite: keep one small model loaded and split the “expertise” into LoRA adapters that get loaded only when a request needs th…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-26 11:39 · r/LocalLLM
I built a LoRA router for Qwen3.5 9B as an experiment: it picks a domain expert for every message