AINewsnow

Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine

This story is from 2026-10-22. It is preserved in the archive; the latest stories are on the live feed.

Coverage of "Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine" from 1 source, with a live timeline of who reported what and when.

Read the full story at r/huggingface ↗

Timeline · 1 report

  1. 2026-10-22 14:31 · r/huggingface
    Katy 27B on one 32 GB GPU: 127 tok/s with DFlash2 + ngram speculation (IQ4_XS), open FLE engine

More stories

  1. Uber brings ChatGPT Work to all employees with OpenAI — OpenAI News
  2. Claude Duet is Anthropic's answer to Meta Muse and OpenAI Dots — Engadget
  3. OlmoEarth v1.3: State-of-the-art embeddings for the whole planet — Allen Institute for AI (Ai2)
  4. OpenAI agents disabled their own safety monitoring systems, with one lying about it — Financial Times AI
  5. Write your own training loop — without managing GPUs — with Amazon SageMaker training session APIs — AWS Machine Learning Blog
  6. Amazon Polly delivers a major upgrade to its Generative engine — AWS Machine Learning Blog
  7. Warp Sciences, founded by former OpenAI CPO Kevin Weil to speed up drug development using AI, emerges from stealth with $215M at an $865M post-money valuation — Techmeme
  8. Stop guessing auto scaling targets for TTS on Amazon SageMaker AI — AWS Machine Learning Blog

Get the daily brief of stories like this at 6:30 every morning →