ISTA-DASLab Squeezes DeepSeek's 763B Model onto a 12 GB GPU

ISTA-DASLab shrinks DeepSeek-V4.1-Flash-1017 to under 2 bits per weight, letting a 763B MoE run locally on a single 12GB consumer GPU.

Read the full story at AlphaSignal ↗

Timeline · 1 report

2026-10-24 12:34 · AlphaSignal
ISTA-DASLab Squeezes DeepSeek's 763B Model onto a 12 GB GPU

More stories

Ran DeepSeek V4.1 Flash 1017 on a single RTX 5090 — r/LocalLLaMA
OK, fine, Qwen 3.8 Flash Next is nice — r/LocalLLaMA
DeepSeek, MiniMax secure open-source licences days after new China export rules: state media — South China Morning Post Tech
CoreWeave Leads MLPerf 0.7 Endpoints Benchmark with DeepSeek-R1 — CoreWeave Blog
China's AI leader DeepSeek raises $15B — Semafor Technology
Looking for a capable, completely free local AI coding agent — r/AI_Agents
DeepSeek and Tencent just opened their own AI search engines. Their authority scores shape what AI answers are built from — r/ArtificialInteligence
DeepSeek reportedly raises $15 billion ahead of potential Shanghai IPO — TechNode

Get the daily brief of stories like this at 6:30 every morning →