Video-as-Experience: Learning Computer Use via Audio-Visual Understanding
This story is from 2026-11-18. It is preserved in the archive; the latest stories are on the live feed.
arXiv:2611.18747v1 Announce Type: new Abstract: Multimodal large language models (LLMs) have enabled capable computer-use agents that perceive graphical user interfaces, reason over instructions, and execute actions. However, existing approaches to learning from video demonstrations typically conve…
Read the full story at arXiv cs.AI ↗
Timeline · 1 report
- 2026-11-18 05:00 · arXiv cs.AI
Video-as-Experience: Learning Computer Use via Audio-Visual Understanding