Got strata running 4x 5060 Ti at 524k context, then abandoned it. repo's here if you want the base
Took the eddoursul/Strata custom fork (the one with the second-GPU expert tier) and turned its 1 main + 1 tier design into 1 + 3, because I have 4x 5060 Ti 16GB on a 9950X. Also ported rope-scaling from upstream main so it runs past the trained 262k. Repo: https://github.com/johnmosesventura06/stra…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-04 16:57 · r/LocalLLM
Got strata running 4x 5060 Ti at 524k context, then abandoned it. repo's here if you want the base