AINewsnow

Tuning Strata to squeeze every drop of performance out of my setup

I'm on a 5950X, dual-channel 128GB DDR4-3200 ECC at stock JEDEC. Inference runs on a VM with 96GB RAM allocated and GPU passthroughs. Strata runs on a single 7900XT at PCIe 4.0 x8, giving a 20GB+96GB mix. I recently switched to Huihui UD-IQ4_XS. 2/3 of the experts are IQ3_S, the other 1/3 IQ4_NL. A…

Read the full story at r/LocalLLM ↗

Timeline · 1 report

  1. 2026-10-16 10:56 · r/LocalLLM
    Tuning Strata to squeeze every drop of performance out of my setup

More stories

  1. Meta releases Muse Spark Open model as NVIDIA launches RTX Spark laptops — AWS Machine Learning Blog
  2. OpenAI Launches Rosalind Academic Plan for U.S. Research Labs — OpenAI News
  3. Apple and Meta Partner to Bring Open-Weight Muse AI Model to Macs — Wall Street Journal Technology
  4. China Proposes Export Controls on AI Technologies and Chips — Wall Street Journal Technology
  5. Reviews Assess Nvidia RTX Spark in Microsoft Surface Laptop Ultra — Techmeme
  6. Cloudflare introduces continuous accountability system for verified AI bots — Cloudflare Blog — AI
  7. New Elizabeth Holmes documentary sparks discussion on tech industry impact — Hard Fork (NYT)
  8. Reports Suggest AGI Exists But Is Overlooked Due to Human Dependence — Fast Company AI

Get the daily brief of stories like this at 6:30 every morning →