What do you think about ToMoE v2 paper, converting dense model to MoE model at near lossless accuracy? I feel Qwen3.8-27B-A16B or something along those lines would be amazing, though there are architectural hurdles, as well as need folr training data.
Coverage of "What do you think about ToMoE v2 paper, converting dense model to MoE model at near lossless accuracy? I feel Qwen3.8-27B-A16B or something along those lines would be amazing, though there are architectural hurdles, as well as need folr training data." from 1 source, with a live timeline of who reported what and when.
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-28 18:35 · r/LocalLLaMA
What do you think about ToMoE v2 paper, converting dense model to MoE model at near lossless accuracy? I feel Qwen3.8-27B-A16B or something along those lines would be amazing, though there are architectural hurdles, as well as need folr training data.
More stories
- NVIDIA Open Agent Safety Platform: A Reference for Continuous In-Silicon Agent Monitoring — NVIDIA Technical Blog
- How we found 24 Android vulnerabilities using our open source AI security agent — GitHub Blog
- Meta Taps MongoDB CEO to Lead New Enterprise AI Platform — Bloomberg AI
- Introducing Claude Sonnet 5.5 on AWS — AWS Machine Learning Blog
- Scoop: Anthropic's Dario Amodei to have White House dinner with Trump — Axios AI+
- Heads of OpenAI and Anthropic called to face Senate inquiry after rogue agent incidents — The Guardian AI
- Bill Gates says unchecked AI could ‘cause a billion deaths’ in call for regulation — The Guardian AI
- OpenAI agents posted user images online, disclose dozens of third party incidents — Axios AI+
Get the daily brief of stories like this at 6:30 every morning →