[D] First measured accuracy fall on my long-horizon 3D benchmark (one demo walk): 2 of 2 near, 3 of 10 far. How many seeds before you would believe it?

Setup. I am building a benchmark for long-horizon 3D spatial reasoning in a simulated warehouse. A robot walks 30 rooms off one corridor; questions ask about things seen 0 to 29 rooms earlier. Answers come from exact simulator state, with no model judge. The target is a clean fall from about 90% to…

Read the full story at r/learnmachinelearning ↗

Timeline · 2 reports

1. 2026-10-07 06:43 · r/deeplearning
   [D] First measured accuracy fall on my long-horizon 3D benchmark (one demo walk): 2 of 2 near, 3 of 10 far. How many seeds before you would believe it?
2. 2026-10-07 06:43 · r/learnmachinelearning
   [D] First measured accuracy fall on my long-horizon 3D benchmark (one demo walk): 2 of 2 near, 3 of 10 far. How many seeds before you would believe it?