You were told to split prefill and decode. Here's when you shouldn't.
https://sathishkumars637097.substack.com/p/disaggregation-depends-on-slo?r=1jbi98&utm_campaign=post-expanded-share&utm_medium=web
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-09-21 20:50 · r/learnmachinelearning
You were told to split prefill and decode. Here's when you shouldn't.