Do models actually use non-visual inputs, or just ignore them and stick to pixels?
This story is from 2026-10-01. It is preserved in the archive; the latest stories are on the live feed.
CV background here, recently getting into robot learning (manipulation with a robot arm). I am wondering - if I have a vision based policy that picks up objects (purely based on pixels) and I add physical info on top (like mass, force, ...), will the model actually use it? Or will it just keep lean…
Read the full story at r/reinforcementlearning ↗
Timeline · 1 report
- 2026-10-01 12:07 · r/reinforcementlearning
Do models actually use non-visual inputs, or just ignore them and stick to pixels?