DeepSWE-mini a 16 instance subset of DeepSWE that replicates the rankings of the leaderboard
I just released a new dataset https://huggingface.co/datasets/LocalLLaMA/deepswe-mini it is meant to be more efficent when testing and benchmarking local models on DeepSwe https://deepswe.datacurve.ai/ The full benchmark takes a while to run so we analyzed it and selected a subset that can faithful…
Read the full story at r/LocalLLaMA ↗
Timeline · 1 report
- 2026-09-18 01:13 · r/LocalLLaMA
DeepSWE-mini a 16 instance subset of DeepSWE that replicates the rankings of the leaderboard