Prime Intellect releases Prime Mega MoE, a trainable backward pass for fused MoE kernel

Prime Intellect released Prime Mega MoE, a backward pass for DeepSeek's fused Mega MoE kernel that makes it trainable and speeds Qwen3 MoE training steps by up to 34% in prime-rl.

Read the full story at MarkTechPost ↗

Timeline · 1 report

2026-10-29 18:28 · MarkTechPost
Prime Intellect Releases Prime Mega MoE: Trainable Fused MoE Kernel, 3.11x Faster Forward Pass

More stories

DeepSeek-V4.1-Flash runs on consumer hardware as users report silent endpoint swap to -1017 variant — r/LocalLLM
AI agents said “done” when nothing actually happened, and making them think harder didn’t help — r/artificial
Used Qwen 3.8 flash next on underspeced PC to Root and gut LG TV of spy and adware — r/LocalLLaMA
Run TeleAI's Xing4.0-29B-A4B GGUF via ik_llama.cpp — Full native mHC/MLA runtime + HF converter — r/LocalLLM
I kept one DeepSeek thread going for six days (742 turns, ~560k words) until it hit its limit. The full export, audited and redacted, is on Zenodo. Started a chat in October to analyze an old essay UKA-135: A Proposed Rooted-Tree Ontology of 135 Research Domains with Epistemic Constraint — r/huggingface
dsh-Go Brings DeepSeek's Coding Agent to Android Without Root Access — AlphaSignal
Pareto frontier for an 2xRTX 3090 on a moderate-size community benchmarks collection — r/LocalLLaMA
Tried to get Qwen 3.8 27b to make the deepseek chibi whale in blender and animate it lol — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →