AINewsnow

[vllm] Is it possible to run Qwen3.8-27B-FP8 on a 5090?

Based on my experiments and feedback from claude, it seems extremely unlikely and even if I get it working, not practical because of minimum context. But just asking here as a last effort. I'm able to run nvfp4 brilliantly and high context with images (or full 256k without images) with the command…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-11 02:12 · r/LocalLLaMA
    [vllm] Is it possible to run Qwen3.8-27B-FP8 on a 5090?

More stories

  1. An Anthropic AI model sent a false homicide tip to Philadelphia police — TechCrunch AI
  2. Anthropic bans users from ‘needless abusive or cruel behavior’ towards Claude — The Guardian AI
  3. Philadelphia police receive false homicide tip from Anthropic AI model — The Hill Technology
  4. Google Cloud introduces Gemini agent to change enterprise work — SiliconANGLE AI
  5. Which AI (ChatGPT,Claude, Gemini,etc) Is The Best All Around For The Money? — r/ArtificialInteligence
  6. Qwen 3.8 Flash Next is so much fun for three.js — r/LocalLLaMA
  7. Claude launches Dashboards and Motion in beta — TestingCatalog AI News
  8. Anthropic changes usage policy to ban model abuse and election interference — TechCrunch AI

Get the daily brief of stories like this at 6:30 every morning →