Nine models, five coding tasks, one 16GB GPU
I ran five coding tasks against nine models on one RX 9060 XT (16 GB). Each run gets a single spec file in an empty directory and has to produce solution.py and test_solution.py , run its own tests, and stop. Grading happens with a checker the model never sees: fixed cases from the spec, randomized…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-10-18 01:22 · r/LocalLLaMA
Nine models, five coding tasks, one 16GB GPU