AINewsnow

Qwen3.8-27B at 140 tok/s on a single RTX 3090 with a custom CUDA megakernel (1.4-1.9x llama.cpp)

I've been using Claude Opus 5.5 to speed up Qwen3.8-27B on my PC (RTX 3090). It wrote a CUDA megakernel that is 1.4-1.9x faster than llama.cpp , depending on the task and context length. https://github.com/L-Forster/open-jet/tree/master/megakernel Speed: same RTX 3090, megakernel vs llama.cpp with…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-11 20:31 · r/LocalLLM
    Qwen3.8-27B at 140 tok/s on a single RTX 3090 with a custom CUDA megakernel (1.4-1.9x llama.cpp)

More stories

  1. Why Muse Wonder Is Dividing AI Users — The AI Daily Brief
  2. Built an anonymous social media viewer with claude code, got ~1M users, then meta started deleting my familys accounts — r/ClaudeAI
  3. Meta says its new AI models on par with OpenAI, Anthropic — TechXplore AI & ML
  4. Anthropic warns AI models may self-replicate on IoT devices within months — CNBC Technology
  5. X Subscription bundles Cursor, Grok, and X Premium — TechCrunch AI
  6. Anthropic's Claude AI submitted false murder tip to Philadelphia police — Ars Technica AI
  7. Meta Unveils New Advanced AI Models to Rival Anthropic and OpenAI — New York Times Technology
  8. Do AIs already process information in a way that gives rise to consciousness? — New Scientist Technology

Get the daily brief of stories like this at 6:30 every morning →