Researchers introduce GAUSS, a workload-aware simulator for LLM inference serving
A new arXiv paper presents GAUSS, an analytical and Monte-Carlo simulator designed to help operators provision, monitor, and bill LLM inference workloads against latency service-level objectives.
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-10-31 04:00 · arXiv cs.AI
GAUSS: A Workload-Aware Analytical and Monte-Carlo Simulator for LLM Inference Serving