AINewsnow

Best opensource coding llm for long context - 5090

Hi folks, Hope you are well. I am using Ninfer NVFP4 Qwen 3.8 27B with DSH for coding. But I feel it's yapping alot in reasoning and drifting in long context. (Tried Swift as well but results are poorer on tasks requiring high reasoning) I am running with speculative decoding and Fp8 kV caching. I…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-24 14:33 · r/LocalLLM
    Best opensource coding llm for long context - 5090

More stories

  1. Qwen 3.8 Flash Next GSQ-RCO IQ_3S at 70tok/s decode/1900tok/s prefill on 2013 Xeon E5-1680v2, 128GB quad channel DDR3-1866 ECC, and an EVGA 3090 FTW3 — r/LocalLLM
  2. Comfy-Org's Qwen-Image-Edit Bundle Hits 1.68M Downloads With Smarter Editing — AlphaSignal
  3. I got tired of "expand image" workflows redrawing my photo, so I built one that only paints the sides (Qwen 2.1, ComfyUI) — r/StableDiffusion
  4. MOSS-Image as an inpainting model... not sure. — r/comfyui
  5. [Benchmark & Review] I tested FLUX.3 Klein (5.6B) across 20 anime styles using both Booru tags and BFL's Official Prompt Guide — Here is why it still lags behind MOSS-Image, Krea 2, and Qwen-Image 2.1 (Full Contact Sheets & Comparisons) — r/comfyui
  6. The new small MOE benchmarks don’t show the real picture. — r/LocalLLM
  7. Qwen Go! Adds My Apps, Letting Users Build Shareable Apps by Description With Alibaba Cloud Meoo — Pandaily
  8. llama: create new fused op for QSA mask by am17an · Pull Request #30640 · ggml-org/llama.cpp — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →