AINewsnow

UPDATE: Qwen 3.8 27B 140 tok/s on single RTX 3090 Megakernel: KL divergence 0.0009 vs llama.cpp

This is a follow-up to my post from yesterday ( https://www.reddit.com/r/LocalLLaMA/comments/1x2erdj/qwen3827b_on_a_single_3090_140_toks_on_code_with/ ) detailing the CUDA megakernel. Thank you all for the positive feedback and PRs! RECAP: The megakernel is a CUDA engine for Qwen3.8-27B that runs 1…

Read the full story at r/LocalLLaMA ↗

Timeline · 2 reports

  1. 2026-10-11 20:31 · r/LocalLLM
    Qwen3.8-27B at 140 tok/s on a single RTX 3090 with a custom CUDA megakernel (1.4-1.9x llama.cpp)
  2. 2026-10-11 13:04 · r/LocalLLaMA
    UPDATE: Qwen 3.8 27B 140 tok/s on single RTX 3090 Megakernel: KL divergence 0.0009 vs llama.cpp

More stories

  1. Running decision models: Picking quant, VRAM usage — r/LocalLLaMA
  2. Qwen 3.8 27B Q4_K_M running on a OnePlus 13 with 24 GB RAM — r/LocalLLM
  3. Users report Qwen 3.8 Flash Next performance on local hardware — r/LocalLLaMA
  4. Built an anonymous social media viewer with claude code, got ~1M users, then meta started deleting my familys accounts — r/ClaudeAI
  5. Meta says its new AI models on par with OpenAI, Anthropic — TechXplore AI & ML
  6. Hacking OpenAI or Anthropic — r/LocalLLM
  7. Meta releases Muse Wonder AI models to compete with frontier rivals — Meta Newsroom
  8. Anthropic warns small AI models may soon self-replicate on IoT devices — CNBC Technology

Get the daily brief of stories like this at 6:30 every morning →