Academic history research agent on 16GB vRAM, context important
Historian here, apologies for my LLM ignorance. Hardware: Nvidia RTX Pro 2000 16GB GDDR7 GPU AMD Ryzen 9 9950X3D CPU V-Color Manta CL28 32GB DDR5 RAM These are the models I was planning on trying via llama.cpp : Swift-1.5-Qwen3.8-27B-GSQ-RCO-IQ3_XXS-mtp Qwen3.8-27B-UD-IQ3_XXS DeepSeek-R1-Distill-Qw…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-17 19:01 · r/LocalLLM
Academic history research agent on 16GB vRAM, context important