AINewsnow

Qwen3.8-27B on free Kaggle 2x T4: 154 tok/s on code with DFlash2, but prose stuck at ~2.5 accepted tokens

Been pushing Qwen3.8-27B on Kaggle's free 2x T4 (no P2P, 70W cap per card) for a while. Current setup: EXL3 4.0bpw on exllamav3, tensor parallel over PCIe, DFlash2 block drafter (7 tokens), greedy and exact vs no-draft. Numbers over a 38 prompt suite: - overall 55-57 tok/s (no draft is ~18-19) - Hu…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-25 11:19 · r/LocalLLM
    Qwen3.8-27B on free Kaggle 2x T4: 154 tok/s on code with DFlash2, but prose stuck at ~2.5 accepted tokens

More stories

  1. Kimi K3.1 Pro and Kimi K3.1 Pro Highspeed are available now in AI Gateway — Vercel Blog
  2. Thomas L. Friedman: We Just Set Off the Second Big Bang — New York Times AI
  3. Qwen 3.8 Flash Next (Q4) got stuck on this loop for hours. I wonder if this is the AI equivalent of having a nightmare and not being able to wake up — r/LocalLLM
  4. Securing our frontier model training environment — OpenAI News
  5. GitHub - vincalkr/DS41Engine: DeepSeek-V4.1-Flash 1017 on 1x-2x RX 7900 XTX (gfx1100, ROCm/HIP): max optimizations — r/LocalLLM
  6. NCERT introduces 20-hour AI module for classes 9-12, covers deepfakes and data privacy — Mint AI
  7. Block unveils Dessa, a "true speech-to-speech" AI model trained on "nothing but human conversation" that it says runs locally on a MacBook Pro M4 Max or newer — Techmeme
  8. A quick MOSS-Image news round-up - 22nd October 2026 — r/comfyui

Get the daily brief of stories like this at 6:30 every morning →