Know if an LLM fits your GPU before you download it
Paste a Hugging Face model id or URL and pick a GPU, a Mac or a custom machine. Vramwise reads the model's parameter counts and config.json live from the Hugging Face API and shows, for every quantization from BF16 down to 4-bit and below, the weights, the KV cache, the total memory, whether it fit…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-21 00:30 · DEV Community — Machine Learning
Know if an LLM fits your GPU before you download it