Qwen 3.6 35b nvfp4 hot expert hack in vllm

This story is from 2026-09-16. It is preserved in the archive; the latest stories are on the live feed.

I’m looking for a similar hack as this: https://huggingface.co/albucino/Qwen3.8-Flash-Next-W4A16-FP8PLE Just for the 35b model and for a single 5060 ti. Anything out there?

Read the full story at r/LocalLLM ↗

Timeline · 1 report

2026-09-16 11:38 · r/LocalLLM
Qwen 3.6 35b nvfp4 hot expert hack in vllm

More stories

Thank you :) Swift Qwen 3.8 27B now has 100k+ downloads, is #1 finetune and #9 model on HuggingFace Trending — r/LocalLLaMA
Alibaba ships Qwen3.8-Omni-Flash to watch, listen and call tools — r/LocalLLM
Qwen 3.8 27B Running for 63 hours on a RTX 3090 to solve the Riemann hypothesis — r/LocalLLaMA
US government website used Chinese model the FBI called "malicious" — Ars Technica AI
Deployed Qwen 3.6 35B A3B on a single DGX Spark supporting 12 concurrent users at 262K context. Are there better ways to optimize this? — r/LocalLLM
Qwen Developers on X: "Qwen-Image 2.1 is going open source" — r/StableDiffusion
Qwen Image 2.1 on Comfy: Coming Soon — r/StableDiffusion
Pay $39.99 once to put ChatGPT, Claude, Gemini, and more in a single workspace for life — Mashable AI

Get the daily brief of stories like this at 6:30 every morning →