LinkedIn engineer details scaling LLM-based ranking for latency-critical search and recommendations
A presentation describes how LinkedIn productionizes LLM ranking under strict P99 latency SLAs, distilling a 7B model to 400M parameters and compressing job contexts.
Read the full story at InfoQ AI/ML ↗
Timeline · 1 report
- 2026-11-17 11:00 · InfoQ AI/ML
Presentation: Scaling LLM-Based Ranking Systems for Latency-Critical Search & Recommendation Workloads