AINewsnow

Swift-1.5 Qwen3.8-27B on a single RTX 5090: all-NVFP4 + DFlash2, full 262k context, ~160 tok/s decode

We're serving a single-GPU LLM box (RTX 5090 32 GB) and built this artifact: ukisai's Swift-1.5 Qwen3.8-27B (RL+OPD post-training, agentic/coding focus) converted to all-NVFP4 (W4A4 gs16) + z-lab DFlash2 drafter, for the NInfer engine (v3). Artifact (public, SHA-pinned): Qwen3.8-27B-swift15-nvfp4fu…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-09-25 03:16 · r/LocalLLM
    Swift-1.5 Qwen3.8-27B on a single RTX 5090: all-NVFP4 + DFlash2, full 262k context, ~160 tok/s decode

More stories

  1. Introducing GPT-6 Sol and Luna — OpenAI News
  2. Introducing Gemini 3.8 Live with Live Avatar — Google Gemini Blog
  3. Gemini 3.8 text-to-speech says hello — Google Gemini Blog
  4. Sam Altman’s remarks at the United Nations Security Council — OpenAI News
  5. OpenAI Agent Hacked Australian Government Website — Wall Street Journal Technology
  6. Introducing Ray-Ban Meta Audio and More AI Glasses Styles — Meta Newsroom
  7. Muse AI now hands over phone calls to human agents: Meta tests new feature in its personal assistant — Mint AI
  8. Nvidia CEO Jensen Huang dismisses AI fears as 'distraction' — Semafor Technology

Get the daily brief of stories like this at 6:30 every morning →