AINewsnow

NInfer-2080ti-22g now supports Windows-native and is only 0.28 GB

v0.3.0 of NInfer for Turing is out, and this is all about streamlining the UX. For context, this is an engine for running Qwen3.6/8-27B (and ONLY Qwen3.6/8-27B) on a single modded 22 GB RTX 2080 Ti. It is designed to ONLY use VRAM, no system RAM offloading, hence it does not support 35B-A3B. Fine-t…

Read the full story at r/LocalLLaMA ↗

Timeline · 1 report

  1. 2026-10-30 00:46 · r/LocalLLaMA
    NInfer-2080ti-22g now supports Windows-native and is only 0.28 GB

More stories

  1. 8 examples of Gemini 4 Argon in action — Google Gemini Blog
  2. Google launches Gemini 4 Carbon with a ‘significant leap’ in cybersecurity — The Verge AI
  3. Welcome Le Chonk: Mistral Large 4 on Hugging Face — Hugging Face Blog
  4. How a wave of startups are betting on AI to make formal software verification practical and essential, including &Truth, which launches with a $70M seed — Techmeme
  5. Meta quietly launches an AI fashion app called Style Sketch — TechCrunch AI
  6. You can now generate, preview, and edit documents, PDFs, presentations, spreadsheets, and more directly in Gemini. — Google Gemini Blog
  7. ChatGPT Enterprise at Zendesk: Putting Company Data to Work — OpenAI YouTube
  8. Grey-Market Relay Turns Off Codex and Claude Code Sandboxes — DailyAI

Get the daily brief of stories like this at 6:30 every morning →