What breaks when a small local model writes SQL against real databases: notes at 7B to 14B
This story is from 2026-09-24. It is preserved in the archive; the latest stories are on the live feed.
Context: we build an open-source (MIT) self-hosted database client and added a natural-language-to-SQL assistant that can point at a local runtime like Ollama instead of a hosted API. I want to share what we learned running local models against real databases, because most NL2SQL demos use a big ho…
Read the full story at r/learnmachinelearning ↗
Timeline · 1 report
- 2026-09-24 15:08 · r/learnmachinelearning
What breaks when a small local model writes SQL against real databases: notes at 7B to 14B