FP8/BF16 users seeing someone run IQ1_S

https://preview.redd.it/egchx5bap8th1.png?width=746&format=png&auto=webp&s=ab25375dcb6c204400ac8ba9b04497ded4c34e25 Why FP8/BF16 get horrified/disgusted even with FP4/INT4 or Any 4 bit quantisation method?

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

2026-10-03 11:47 · r/LocalLLaMA
FP8/BF16 users seeing someone run IQ1_S

More stories

NVIDIA DGX Spark 64GB Gives Developers More Ways to Build and Scale Local AI — NVIDIA Blog
Gemini 4 Argon: our next era of frontier intelligence — Google Gemini Blog
Google tests its plan for AI data centers in space with Project Suncatcher — Scientific American
Guided Vision in Gemini Live: built for accessibility — Google Gemini Blog
Google announces Gemini 4 Argon AI model, but you can't use it yet — Ars Technica AI
Apple says it's tightening macOS Full Disk Access' controls due to new risks from AI agents — TechCrunch AI
OpenAI DevDay 2026 Keynote (FULL) — OpenAI YouTube
The latest AI news we announced in September 2026 — Google Gemini Blog

Get the daily brief of stories like this at 6:30 every morning →