Faster than strata and ninfer
for my use i worked in optimising first ninfer than flash next on my workstation. the workstation i build was the cheaper i can go without losing real performance in theory. so i got double 5070ti and 96 ddr5 5700 cl40. this week i finally closed the first iteration of my inference engine optimised…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-18 06:41 · r/LocalLLM
Faster than strata and ninfer