AINewsnow

NVFP4 vs FP8 vs GGUF on a 16 GB Ada GPU: NVFP4 decodes 2.3x faster and ties BF16 on GSM8K

When you type «nvfp4 vs» into Google it completes with «fp8», «gguf», «q4_k_m» and «bf16». The usual answer compares different models quantized by different people. On October 16 NVIDIA released Nemotron Labs Dory 1.0 4B in BF16, NVFP4, MXFP8 and GGUF at once, so I measured the same model in every…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-10-18 01:56 · DEV Community — Machine Learning
    NVFP4 vs FP8 vs GGUF on a 16 GB Ada GPU: NVFP4 decodes 2.3x faster and ties BF16 on GSM8K

More stories

  1. QUASAR 4-bit QAT checkpoints for Qwen3.5, Gemma 4 and Muse Glimmer: closer to BF16 than Google’s and NVIDIA’s 4-bit releases — r/LocalLLaMA
  2. NVIDIA RTX Spark Laptops Launch Globally With Local AI Agent Support — NVIDIA Blog
  3. RTX Spark Ignites Global Celebration as New Windows PCs Arrive — NVIDIA Blog
  4. Google releases Gemini 4 Argon for Pro subscribers with limited usage caps — r/GeminiAI
  5. Anthropic offers Blackstone double-digit yield in $60B chip financing deal — Financial Times AI
  6. Google Research details building blocks for autonomous wet labs — Google Research Blog
  7. AWS, Anthropic Deploy Specialized Engineers to Prove AI ROI — CNBC Technology
  8. Hinton and Huang Clash Over AI Safety and Chip Sales — CNBC Technology

Get the daily brief of stories like this at 6:30 every morning →