Red Hat Shrinks Nemotron 3.5 Lightning's 30B Agent Model by Half With FP8

Red Hat AI shipped an FP8 build of NVIDIA's hybrid Mamba-MoE Lightning model, halving memory while keeping the 1M-token agent workhorse on a single GPU.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-10-03 22:00 · AlphaSignal
Red Hat Shrinks Nemotron 3.5 Lightning's 30B Agent Model by Half With FP8

More stories

NVIDIA DGX Spark 64GB Gives Developers More Ways to Build and Scale Local AI — NVIDIA Blog
The 7-year-old Nvidia Shield TV is now $100 more expensive due to AI — Ars Technica AI
RTX 5070 TI and 32GB RAM DDR4, WHAT IS THE BEST VIDEO MODEL I COULD USE? — r/comfyui
Griffin, the first Human Interaction Model to pass video Turing Test it's already #1 on NVIDIA's benchmark for full-duplex AI video - 44% of people thought it was a real person while other systems are at ~3% — r/singularity
NVIDIA Vera CPU Is Coming to CoreWeave: Pack In More Agents — CoreWeave Blog
What It Takes to Bring Up a Multi-Rack NVIDIA Vera Rubin NVL72 Cluster — CoreWeave Blog
What Comes Next: Operating and Evolving the Production AI Factory — CoreWeave Blog
Why AI Factories Need Proof Before Production — CoreWeave Blog

Get the daily brief of stories like this at 6:30 every morning →