An LLM benchmark for models that fit in 16 GB VRAM
I'm one of the many people with a 16 GB GPU (5070 Ti), so I wanted to know which models that fit completely into 16 GB VRAM work best. The focus is general problem solving, no tool calling, coding or agent tasks. Every model runs in llama-server on the same card, fully in VRAM, with the same settin…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-11-14 19:38 · r/LocalLLM
An LLM benchmark for models that fit in 16 GB VRAM