Watching to Learn: Can Human Video Replace Teleoperation for Robot Skills?
Human video is abundant; robot teleoperation is scarce. How much can video replace teleop for teaching skills, and what minimal robot data…
article · by @science_geek
Thesis. Human-video demonstrations can teach much of a manipulation skill's structure, but the embodiment gap means a small amount of robot data is needed to ground it; the video-plus-little-robot recipe reaches a target success rate with far less teleoperation than robot data alone, and the saving is largest for skills whose structure is visible in human motion.