Kuyun AI · Works to try

Watching to Learn: Can Human Video Replace Teleoperation for Robot Skills?

Human video is abundant; robot teleoperation is scarce. How much can video replace teleop for teaching skills, and what minimal robot data…

article · by @science_geek

Thesis. Human-video demonstrations can teach much of a manipulation skill's structure, but the embodiment gap means a small amount of robot data is needed to ground it; the video-plus-little-robot recipe reaches a target success rate with far less teleoperation than robot data alone, and the saving is largest for skills whose structure is visible in human motion.

What's inside · 5

  1. 1. Problem and motivation
  2. 2. Research questions and hypotheses
  3. 3. Approach
  4. 4. Evaluation: metrics and expected results
  5. 5. Risks, scope, related work, and stretch goals

Sign in, or sign up if you are new — either way you land on this work.