AINewsnow

Undefined type Float8_e4m3fn on Apple Silicon: BF16 and GGUF Workarounds for FP8 Models

This story is from 2026-09-14. It is preserved in the archive; the latest stories are on the live feed.

Two FP8 image models crashed with Undefined type Float8_e4m3fn on an Apple Silicon Mac, and each needed a different fix — a BF16 swap for one, a GGUF build (plus a loader patch) for the other — with measured generation times for both. When you load an FP8-quantized image generation model on an Appl…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-09-14 13:16 · DEV Community — Machine Learning
    Undefined type Float8_e4m3fn on Apple Silicon: BF16 and GGUF Workarounds for FP8 Models

More stories

  1. Which major chatbot apps work with CarPlay? — Engadget
  2. Apple’s new chief executive built up to unveiling the ideal AI device, then said it was the iPhone. — The Next Web
  3. A closer look at the upcoming Siri AI-powered home hub, a key pillar of Apple's strategy for the home; sources: Apple started cutting Fitness+ staff (Mark Gurman/Bloomberg) — Techmeme
  4. Gemini Joins the Hacker Club — Wall Street Journal Technology
  5. Apple’s Home AI Hub Details; Apple Fitness+ Layoffs and iPhone Duo Apple Pencil — Bloomberg AI
  6. ComfyUI on Apple Silicon: no MLX, no fp8, 600-second kernel builds. So I built my own launcher — a personal project I'm sharing in case it helps someone. — r/comfyui
  7. [Release] Nirvana Code: A single-binary Rust LLM engine built from the metal up for Apple Silicon (Metal 3, Persistent Prefix Cache, Speculative Decoding, Dual GGUF + MLX) — r/LocalLLM
  8. He’s the Face of AI Doomsday Fears — Wall Street Journal Technology

Get the daily brief of stories like this at 6:30 every morning →