RAPTOR: Role-Aware Private Training for Mixture-of-Experts
This story is from 2026-09-09. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2609.05770v1 Announce Type: new Abstract: Differentially private (DP) fine-tuning methods treat sparse Mixture-of-Experts (MoE) models as a single dense block, ignoring that shared layers see all data while experts only see routed records. We identify and formally characterize three resulting…
Read the full story at arXiv cs.LG ↗
Timeline · 1 report
- 2026-09-09 04:00 · arXiv cs.LG
RAPTOR: Role-Aware Private Training for Mixture-of-Experts