Legibility and predictability of robot motion

A key requirement for seamless human-robot collaboration is for the robot to make its intentions clear to its human collaborator. A collaborative robot's motion must be legible, or intent-expressive. Legibility is often described in the literature as and effect of predictable, unsurprising, or expected motion. Our central insight is that predictability and legibility are fundamentally different and often contradictory properties of motion. We develop a formalism to mathematically define and distinguish predictability and legibility of motion. We formalize the two based on inferences between trajectories and goals in opposing directions, drawing the analogy to action interpretation in psychology. We then propose mathematical models for these inferences based on optimizing cost, drawing the analogy to the principle of rational action. Our experiments validate our formalism's prediction that predictability and legibility can contradict, and provide support for our models. Our findings indicate that for robots to seamlessly collaborate with humans, they must change the way they plan their motion.

[1]  M. Tinker Legibility of print , 1963 .

[2]  J. F. Soechting,et al.  Coordination of arm and wrist motion during a reaching task , 1982, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[3]  T. Flash,et al.  The coordination of arm movements: an experimentally confirmed mathematical model , 1985, The Journal of neuroscience : the official journal of the Society for Neuroscience.

[4]  Andrew P. Witkin,et al.  Spacetime constraints , 1988, SIGGRAPH.

[5]  Z. Nadasdy,et al.  Taking the intentional stance at 12 months of age , 1995, Cognition.

[6]  Michael Gleicher,et al.  Retargetting motion to new characters , 1998, SIGGRAPH.

[7]  G. Csibra,et al.  The teleological origins of mentalistic action explanations: A developmental hypothesis , 1998 .

[8]  A. Woodward Infants selectively encode the goal object of an actor's reach , 1998, Cognition.

[9]  John Lasseter,et al.  Principles of traditional animation applied to 3D computer animation , 1987, SIGGRAPH.

[10]  Stefan Schaal,et al.  Computational approaches to motor learning by imitation. , 2003, Philosophical transactions of the Royal Society of London. Series B, Biological sciences.

[11]  Jeffrey M. Bradshaw,et al.  Ten Challenges for Making Automation a "Team Player" in Joint Human-Agent Activity , 2004, IEEE Intell. Syst..

[12]  B. Sodian,et al.  Infants' Understanding of Looking, Pointing, and Reaching as Cues to Goal-Directed Action , 2004 .

[13]  Pieter Abbeel,et al.  Apprenticeship learning via inverse reinforcement learning , 2004, ICML.

[14]  T. Kanda,et al.  Six-and-a-half-month-old children positively attribute goals to human action and to humanoid-robot motion , 2005 .

[15]  Jiping He,et al.  Control of hand orientation and arm movement during reach and grasp , 2006, Experimental Brain Research.

[16]  W. Prinz,et al.  The understanding of own and others' actions during infancy: "You-like-me" or "Me-like-you" , 2007 .

[17]  M. Tomasello,et al.  Understanding and sharing intentions: The origins of cultural cognition , 2005, Behavioral and Brain Sciences.

[18]  H. Wellman,et al.  Infants' understanding of object-directed action , 2005, Cognition.

[19]  J. Andrew Bagnell,et al.  Maximum margin planning , 2006, ICML.

[20]  Rachid Alami,et al.  Toward Human-Aware Robot Task Planning , 2006, AAAI Spring Symposium: To Boldly Go Where No Human-Robot Team Has Gone Before.

[21]  G. Giralt,et al.  Safe and dependable physical human-robot interaction in anthropic domains: State of the art and challenges , 2006, 2006 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[22]  G. Csibra,et al.  'Obsessed with goals': functions and mechanisms of teleological interpretation of actions in humans. , 2007, Acta psychologica.

[23]  Anind K. Dey,et al.  Maximum Entropy Inverse Reinforcement Learning , 2008, AAAI.

[24]  Daniel H. Grollman,et al.  Sparse incremental learning for interactive robot control policy estimation , 2008, 2008 IEEE International Conference on Robotics and Automation.

[25]  Siddhartha S. Srinivasa,et al.  CHOMP: Gradient optimization techniques for efficient motion planning , 2009, 2009 IEEE International Conference on Robotics and Automation.

[26]  Brett Browning,et al.  A survey of robot learning from demonstration , 2009, Robotics Auton. Syst..

[27]  Chris L. Baker,et al.  Action understanding as inverse planning , 2009, Cognition.

[28]  Rachid Alami,et al.  Planning Safe and Legible Hand-over Motions for Human-Robot Interaction , 2010 .

[29]  Michael Beetz,et al.  Generality and legibility in mobile manipulation , 2010, Auton. Robots.

[30]  Tore Dybå,et al.  Inferring Skill from Tests of Programming Performance: Combining Time and Quality , 2011, 2011 International Symposium on Empirical Software Engineering and Measurement.

[31]  Andrea Lockerd Thomaz,et al.  Generating anticipation in robot motion , 2011, 2011 RO-MAN.

[32]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[33]  Siddhartha S. Srinivasa,et al.  Manipulation planning with goal sets using constrained trajectory optimization , 2011, 2011 IEEE International Conference on Robotics and Automation.

[34]  Alexandra Kirsch,et al.  Towards a Legibility Metric: How to Measure the Perceived Value of a Robot , 2011, ICSR 2011.

[35]  Siddhartha S. Srinivasa,et al.  Learning from Experience in Manipulation Planning: Setting the Right Goals , 2011, ISRR.

[36]  Jessica K. Hodgins,et al.  Exploring the neural correlates of goal-directed action and intention understanding , 2011, NeuroImage.

[37]  Siddhartha S. Srinivasa,et al.  Formalizing Assistive Teleoperation , 2012, Robotics: Science and Systems.

[38]  Ross A. Knepper,et al.  Herb 2.0: Lessons Learned From Developing a Mobile Manipulator for the Home , 2012, Proceedings of the IEEE.

[39]  Sergey Levine,et al.  Continuous Inverse Optimal Control with Locally Optimal Examples , 2012, ICML.

[40]  Nicholas Roy,et al.  Contextual Sequence Prediction with Application to Control Library Optimization , 2013 .