I built a tiny site that let's you feel the tokens/s before you buy the GPU
This story is from 2026-08-29. It is preserved in the archive; the latest stories are on the live feed.
I made a tiny site that let's you feel how fast a local LLM runs before buying the hardware. I made it for myself and a friend but thought it could be useful for others. Note that it works as an estimate and not perfectly as it will vary per user setup. repo: https://github.com/albinstman/llmspeed…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-08-29 18:14 · r/LocalLLM
I built a tiny site that let's you feel the tokens/s before you buy the GPU