AINewsnow

Ninfer-rtx3060 gets 50 tok/s for Swift-1.5-Qwen3.8-27b

Found https://github.com/5258mf/ninfer-rtx3060-27b , a 3060 port with Swift IQ3_XXS Decode ~50 tok/s (44 to 52) KV 46,400 tokens, 131K context Pass beautifully in 1st try one liner prompt. https://preview.redd.it/foylq6fzclvh1.png?width=1917&format=png&auto=webp&s=06a9a5294ffbe0a2c1a7fa101c98dfe5de…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-15 08:34 · r/LocalLLM
    Ninfer-rtx3060 gets 50 tok/s for Swift-1.5-Qwen3.8-27b

More stories

  1. Anthropic reports $16.8 billion Q3 revenue ahead of planned IPO — New York Times Technology
  2. NVIDIA RTX Spark Superchip Outperforms Apple M5 Max in AI Benchmarks — Engadget
  3. Google launches its ‘universal' online shopping cart ahead of the holidays — The Verge AI
  4. Bank of America hired 1,000 contractors to patch software flaws exposed by Anthropic's Mythos — CNBC Technology
  5. Anthropic warns AI models may self-replicate on IoT devices within months — Financial Times AI
  6. Amazon Launches Bee AI Wearables With $12 Monthly Subscription — Bloomberg AI
  7. Amazon launches new Bee personal AI devices starting at $75 — TechCrunch AI
  8. An intelligent new shopping cart — Google Gemini Blog

Get the daily brief of stories like this at 6:30 every morning →