Calibrating an LLM-as-Judge for a Vision Check to κ 0.80
This story is from 2026-10-15. It is preserved in the archive; the latest stories are on the live feed.
At AutoKon, a construction platform where I was founding CTO and sole engineer, a contractor's payment was released only after the field photos passed an AI check. Claude Opus Vision, with Pinecone retrieval for context, described what each photo showed. A separate LLM-as-judge pipeline in Arize AX…
Read the full story at DEV Community — Machine Learning ↗
Timeline · 1 report
- 2026-10-15 12:50 · DEV Community — Machine Learning
Calibrating an LLM-as-Judge for a Vision Check to κ 0.80