AINewsnow

Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine

Coverage of "Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine" from 2 sources, with a live timeline of who reported what and when.

Read the full story at r/huggingface ↗

Timeline · 2 reports

  1. 2026-10-22 14:31 · r/huggingface
    Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine
  2. 2026-10-22 14:29 · r/LocalLLM
    Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine

More stories

  1. Anthropic donates the Agent Skills open standard to the Agentic AI Foundation and says 70+ platforms have integrated it, after donating MCP to the AAIF in 2025 (Anthropic) — Techmeme
  2. Train Qwen3 on AWS Trainium with torchtitan — AWS Machine Learning Blog
  3. MOSS-Image-SFT 3 step lora is out — r/StableDiffusion
  4. Hugging Face ❤️ TorchTPU: TPUs, Natively — Hugging Face Blog
  5. KFlash: Benchmarks of newly released versions of Apple Silicon optimized engines: 1.4.0 Splash (DFlash2 ~ 50 tok/s) vs 0.2 Kapitsa (KFlash ~65 tok/s), MLX(MTP) & more on Qwen 3.8 27b/4b/35b 4Q on Macbook Pro M4 Pro 48 GB 2024, 48GB & Macbook Pro M1 Pro 16GB 2021 — r/LocalLLaMA
  6. Artistic application of monocular depth estimation – Vathography — r/computervision
  7. Which Qwen 3.8 27B NVFP4 quant is better? Nvidia or Unsloth? — r/LocalLLM
  8. Hugging Face’s New AI Biology Model Lets You Chat With DNA — Wired AI

Get the daily brief of stories like this at 6:30 every morning →