Llama.cpp performance improvement over time (Gemma4 models)
Few months ago - after Ninfer came out - I started a little hobby project to vibe-code my own engine for my hardware (RTX 5080 16GB Laptop) and check if it could beat llama.cpp - since at the time llama.cpp was kinda slow in comparison to something like vLLM, but vLLM is using VRAM very wastefully.…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-11-15 20:34 · r/LocalLLaMA
Llama.cpp performance improvement over time (Gemma4 models)