Qwen3.8-Flash-Next: Swift 1.5 vs Unsloth on Strix Halo (Halogen, gufo, llama.cpp, UD-Q4_K_XL and IQ4_XS)
Here I am with another benchmark/comparison. I was curious about the efficiency claims of Swift 1.5 , UkisAI's fine-tune of Qwen3.8-Flash-Next that thinks for a shorter time. UkisAI says Swift uses 63% fewer thinking tokens with under 1% accuracy loss. I compared it with my current setup ( Halogen…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-26 08:47 · r/LocalLLaMA
Qwen3.8-Flash-Next: Swift 1.5 vs Unsloth on Strix Halo (Halogen, gufo, llama.cpp, UD-Q4_K_XL and IQ4_XS)
More stories
- Introducing Zest: model server + agent + friendly GUI — r/LocalLLaMA
- I made Pumpkin, a graphical manager for llama.cpp for my girlfriend. It turned out well, so I put it on github — r/LocalLLaMA
- Qwen3.8-27B Q6 on one RTX 5090: 69 → 100 tok/s short, 35 → 64 tok/s at 120K context, just by leaving LM Studio for a native llama.cpp build (full benchmarks + recipe) — r/LocalLLM
- Merge-Based Vocabulary Extension Stalls at the Pre-Tokenizer: An English-Preserving Repair for Nepali, Tested in Continued Pretraining — arXiv cs.CL
- Nanbeige4.3-33B Q4 on a MacBook Pro M5 Max, mlx-lm vs llama.cpp vs Kapitsa, Prefill/Decode 512 to 32K range. — r/LocalLLaMA
- Quad 3090 vs 256 M5 Ultra For Agentic Coding — r/LocalLLM
- Update: MAFDET now runs on Apple Silicon. Qwen3-14B answers in 12 s instead of 33 on an M2 Pro — r/LocalLLM
- I created a benchmark to test local LLMs on your Snapdragon NPU (open source) — r/LocalLLM
Get the daily brief of stories like this at 6:30 every morning →