Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU
TL;DR We serve Meta's Muse Spark Open, an 816B-parameter mixture-of-experts model, on a single TPU v7 host of four chips, with SGLang running on the TorchTPU PyTorch backend. At the... The post Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU appeared first on PyTorch .
Read the full story at PyTorch Blog ↗
Timeline · 1 report
- 2026-11-10 16:45 · PyTorch Blog
Optimizing Muse Spark Open on TPU v7 with SGLang-TorchTPU