First LLM Server - Questions
So I've been using this machine for a while for Stable Diffusion tasks (RTX 3060 12GB) and i got curious about local LLM's so i got a really dirt cheap Nvidia Tesla P100 16GB just to start out on and experiment as my RTX card is often in constant use. I'm currently running the following and this is…
Read the full story at r/LocalLLM ↗
Timeline · 1 report
- 2026-10-12 10:47 · r/LocalLLM
First LLM Server - Questions