A proxy that watches the yes/no and pick-one decisions your app asks an LLM for, then trains a local model to make them for free
Most of what apps ask an LLM for in production is not prose, it is small closed decisions: which queue, is this urgent, is this safe to run, which of these five. Paying a hosted model per call for those, forever, felt wrong, so I built stuntd. It is a local proxy. Your app keeps calling its provide…
Read the full story at r/artificial ↗