I built a tiny table that learns your local LLM's classification answers and serves the repeats in microseconds [D]
project: https://2796gaurav.github.io/shad0w/ If you use a local model for classification, you know the wait: seconds per message, for questions it has answered hundreds of times. shad0w sits in front of any OpenAI-compatible server (Ollama works out of the box: llm="ollama/llama3.1" or `shad0w pro…
Read the full story at r/MachineLearning ↗
Timeline · 1 report
- 2026-10-12 07:33 · r/MachineLearning
I built a tiny table that learns your local LLM's classification answers and serves the repeats in microseconds [D]