Meta's Andromeda ad retrieval system processes 1 billion ads per second on one server

Meta and NVIDIA fused ad retrieval into a single GPU kernel in the Andromeda system, achieving over 1 billion ads per second per server while maintaining ranking-level quality.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-11-02 17:05 · AlphaSignal
Meta's Andromeda Retrieves 1 Billion Ads per Second on One Server

More stories

769 tok/s on a Single RTX 4090: Spark-X2.6-1.7B DSpark — DEV Community — Machine Learning
[Project] vLLM on Windows ARM64 for NVIDIA RTX Spark (with benchmarks) — r/LocalLLM
Nvidia expands beyond GPUs as Meta's Muse agent stack deepens AI infrastructure push — DigiTimes Asia
Spark-X2.6-4B DSpark Is Here: More Than 2x Average BF16 Inference Speed — DEV Community — Machine Learning
Marvell to acquire optical components maker Lumentum in $115 billion all-stock deal — DigiTimes Asia
OpenAI lowers funding target for new round to $20 billion — Financial Times AI
NVIDIA Details Kubernetes Setup for Vera Rubin GPU Support — NVIDIA Technical Blog
Nvidia in talks to guarantee debt for Nscale's West Virginia AI data center — Economic Times Tech

Get the daily brief of stories like this at 6:30 every morning →