Expert expansion with llama.cpp
This story is from 2026-09-06. It is preserved in the archive; the latest stories are on the live feed.
With the help of Glm 5.3 flash I built a custom branch of llama.cpp in order to support Expert expansion with MOE models, I've tested only on metal and It works better than my DS4 version , i need feedback from other platforms, and different models. moex-expansion
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-06 18:27 · r/LocalLLaMA
Expert expansion with llama.cpp