AINewsnow

Run Gemma 4 31B-it Uncensored on a 12GB GPU: Complete Local Vision & 256K Context Guide with llama.cpp, DeepSeek Harness & Hermes Agent

Figure 1: Gemma 4 31B-it ARA Heretic local deployment topology uniting quantized 31B weights, multimodal CLIP vision (mmproj), and downstream DeepSeek Harness + Hermes Agent clients over localhost:8085. Running a 31-billion parameter foundation model locally with native image understanding, uncenso…

Read the full story at DEV Community — Machine Learning ↗

Timeline · 1 report

  1. 2026-11-11 07:34 · DEV Community — Machine Learning
    Run Gemma 4 31B-it Uncensored on a 12GB GPU: Complete Local Vision & 256K Context Guide with llama.cpp, DeepSeek Harness & Hermes Agent

More stories

  1. DeepSeek V4.1 Flash API: Clean and Tag 10,000 Comments, and What It Costs — DEV Community — AI
  2. Llama-modchip: 284B DeepSeek on 64GB RAM, no GPU — Hacker News Front Page
  3. Config-Verified Comparison Maps How 10 Open MoE Models Route Tokens — MarkTechPost
  4. DeepSeek's Harness agent app reaches 1.54 million daily users — Bloomberg AI
  5. Local AI inference gains ground as compact desktop hardware and new Mac app target on-device model serving — DEV Community — Machine Learning
  6. Comparing 7 Chinese frontier models through one API — a field guide, not a benchmark — DEV Community — AI
  7. Ripple-65B Preview Benchmark: Gauntlet, Forge 2.0, LFM3-1.7B — DEV Community — AI
  8. llama.cpp: Add FP8 KV-cache — r/LocalLLaMA

Get the daily brief of stories like this at 6:30 every morning →