RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp
This is big. Imagine running your model across multiple computers, and now imagine doing tensor parallelism across all of them.
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-06 15:45 · r/LocalLLaMA
RPC: add `-sm tensor` by am17an · Pull Request #26610 · ggml-org/llama.cpp