How Was your experience running Q1 Models on your machine?
Also Q2 and Q3 are they really that bad as people around say? or it depends highly on the model architecture and the quantize technique? is there Big difference between UD-Q and IQ? is Q1 really worst Quantization Available or no? and who would win? Small Q4 Model? or Huge 200B+ MoE Q1 model? submi…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-20 00:36 · r/LocalLLaMA
How Was your experience running Q1 Models on your machine?