Strata and UD-Q4_K_XL on 96GB?
Curious if anyone has tried this, and if so, how does it run? Seen a number of folks with 128GB system ram have tried it, but specifically curious about 96GB and whether it's worth the trouble for me to add another 32GB. I'm currently running 2x32GB system ram and an RTX 4090, using the IQ3_S model…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-04 03:01 · r/LocalLLM
Strata and UD-Q4_K_XL on 96GB?