AINewsnow

Qwen 3.8 27B Derivative on a 12GB RTX 3060: Up to 44 Tokens/s, Vision, Tools, and 128K Context Fully in VRAM

[Edit] Quick demo (recording the screen / ugly / grammar errors): https://youtu.be/YKar1W0qb_I Hi. I'm a software developer, and this is my best setup so far for running fast, useful local AI on consumer hardware. The goal is a useful local assistant: good speed, fewer mistakes, tools, vision, and…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-26 04:18 · r/LocalLLM
    Qwen 3.8 27B Derivative on a 12GB RTX 3060: Up to 44 Tokens/s, Vision, Tools, and 128K Context Fully in VRAM

More stories

  1. ran qwen 3.5 9B on my phone and get 1 tok/s, just saying. (iqoo z9x 12GB) — r/LocalLLM
  2. Microsoft Decision-1: 9B Qwen Model Launch Explained — Hacker News Front Page
  3. Looking for advice on choosing a model — r/MLQuestions
  4. qwen4exp : build the QSA selection without the kq_mask by sanmai · Pull Request #30965 · ggml-org/llama.cpp — r/LocalLLaMA
  5. Setting up Claude as a "Supervisor" over Qwen? — r/LocalLLM
  6. Advice on literature review / semantic search on PDF library — r/LocalLLM
  7. Same game built twice: Opus alone vs Opus planning + local Qwen coding. 16 min vs 42 min, $2.52 vs $0.62 — r/ClaudeAI
  8. I ran a blind test on local AI agents. Here are the results, guess who's who — r/AI_Agents

Get the daily brief of stories like this at 6:30 every morning →