AINewsnow

How do you code with your local model?

I feel like I need to change how I prompt. I have been using opus and sol mainly and I got accustomed to just throwing things at them. I got 2 p100s running and I would say qwen 3.8 35B Q6 runs at an acceptable 25t/s with about 128k context. I throw my personal bench test at it (it's to build a clo…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-11 23:48 · r/LocalLLM
    How do you code with your local model?

More stories

  1. Qwen-Image 2.1 Turbo gains support across local AI tools and ComfyUI — r/StableDiffusion
  2. Import Skills Into Web Ver. of ChatGPT/Claude/Gemini. Prompt DB + Queueing prompts w/ Multimodal Support — r/PromptEngineering
  3. AI Image alignment solution for Qwen Image 2.1 Edits — r/StableDiffusion
  4. Qwen3.6 35B-A3B optimized for a 4 GB GTX 1050 Ti Mobile: up to 2× prefill and 3× decode vs llama.cpp — r/LocalLLM
  5. Request GRANTED! 8GB VRAM Qwen 2.1 Image Editor And Art Styler. — r/StableDiffusion
  6. MCP - Qwen2.1 Turbo + Kandinsky Lite Video Gen on 8GB VRAM — r/StableDiffusion
  7. Thinking vs Instruct for Qwen 3.8 27b — r/LocalLLM
  8. Gen Al on a laptop? — r/LocalLLM

Get the daily brief of stories like this at 6:30 every morning →