Playing catch with robots: Incorporating social gestures into physical interactions

For compelling human-robot interaction, social gestures are widely believed to be important. This paper investigates the effects of adding gestures to a physical game between a human and a humanoid robot. Human participants repeatedly threw a ball to the robot, which attempted to catch it. If the catch was successful, the robot threw the ball back to the human. For half of the cases in which the catch was unsuccessful, the robot made a physical gesture, such as shrugging its shoulders, shaking its head, or throwing up its hands. In the other half of cases, no gestures were produced. We used questionnaires and smile detection to compare participants' feelings about the robot when it made gestures after failure versus when it did not. Participants smiled more and rated the robot as more engaging, responsive, and humanlike when it gestured. We conclude that social gesturing of a robot enhances physical interactions between humans and robots.

[1]  A. Bruce.  Emotional Expression , 1883, The American Naturalist.

[2]  R. Riggio,et al.  The display of personality in expressive movement , 1990 .

[3]  Jean-Jacques E. Slotine,et al.  Experiments in Robotic Catching , 1991, 1991 American Control Conference.

[4]  A. Kendon.  Some Recent Work from Italy on Quotable Gestures (Emblems) , 1992 .

[5]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[6]  C.D. Martin,et al.  The Media Equation: How People Treat Computers, Television and New Media Like Real People and Places [Book Review] , 1997, IEEE Spectrum.

[7]  T. Hettmansperger,et al.  Robust Nonparametric Statistical Methods , 1998 .

[8]  R. Lippa.  The Nonverbal Display and Judgment of Extraversion, Masculinity, Femininity, and Gender Diagnosticity: A Lens Model Analysis , 1998 .

[9]  S. Goldin-Meadow,et al.  The role of gesture in communication and thinking , 1999, Trends in Cognitive Sciences.

[10]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[11]  Günter Schreiber,et al.  Off-the-shelf vision for a robotic ball catcher , 2001, Proceedings 2001 IEEE/RSJ International Conference on Intelligent Robots and Systems. Expanding the Societal Role of Robotics in the the Next Millennium (Cat. No.01CH37180).

[12]  Christopher G. Atkeson,et al.  Robot Catching: Towards Engaging Human-Humanoid Interaction , 2002, Auton. Robots.

[13]  Aaron Powers,et al.  Matching robot appearance and behavior to tasks to improve human-robot cooperation , 2003, The 12th IEEE International Workshop on Robot and Human Interactive Communication, 2003. Proceedings. ROMAN 2003..

[14]  Fumio Miyazaki,et al.  Tracking and catching of 3d flying target based on gag strategy , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[15]  Candace L. Sidner,et al.  Where to look: a study of human-robot engagement , 2004, IUI '04.

[16]  Ronald C. Arkin,et al.  Human perspective on affective robotic behavior: a longitudinal study , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[17]  Kerstin Dautenhahn,et al.  Socially intelligent robots: dimensions of human–robot interaction , 2007, Philosophical Transactions of the Royal Society B: Biological Sciences.

[18]  Susan A. Murphy,et al.  Monographs on statistics and applied probability , 1990 .

[19]  Koichiro Deguchi,et al.  A goal oriented just-in-time visual servoing for ball catching robot arm , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[20]  Heeyoung Kim,et al.  Personality design of sociable robots by control of gesture design factors , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[21]  Andreas Ernst,et al.  A Modular Framework to Detect and Analyze Faces for Audience Measurement Systems , 2009, GI Jahrestagung.

[22]  Masatoshi Ishikawa,et al.  Skillful manipulation based on high-speed sensory-motor fusion , 2009, 2009 IEEE International Conference on Robotics and Automation.

[23]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[24]  Chrystopher L. Nehaniv,et al.  Drum-mate: interaction dynamics and gestures in human–humanoid drumming experiments , 2010, Connect. Sci..

[25]  Berthold Bäuml,et al.  Kinematically optimal catching a flying ball with a hand-arm-system , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[26]  Cynthia Breazeal,et al.  MeBot: A robotic platform for socially embodied telepresence , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[27]  Haiyan Wu,et al.  Dynamic manipulation: Nonprehensile ball catching , 2010, 18th Mediterranean Conference on Control and Automation, MED'10.

[28]  Berthold Bäuml,et al.  Realtime perception for catching a flying ball with a mobile humanoid , 2011, 2011 IEEE International Conference on Robotics and Automation.

[29]  Wendy Ju,et al.  Expressing thought: Improving robot readability with animation principles , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[30]  Oliver Birbach,et al.  Estimation and prediction of multiple flying balls using Probability Hypothesis Density filtering , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Alexander Dietrich,et al.  Catching flying balls with a mobile humanoid: System overview and design considerations , 2011, 2011 11th IEEE-RAS International Conference on Humanoid Robots.

[32]  Gerd Hirzinger,et al.  Trajectory planning for optimal robot catching in real-time , 2011, 2011 IEEE International Conference on Robotics and Automation.

[33]  Matthew Glisson,et al.  Playing catch and juggling with a humanoid robot , 2012, 2012 12th IEEE-RAS International Conference on Humanoid Robots (Humanoids 2012).

[34]  Stefan Kopp,et al.  To Err is Human(-like): Effects of Robot Gesture on Perceived Anthropomorphism and Likability , 2013, International Journal of Social Robotics.

[35]  Anthony G. Pipe,et al.  Perception of own and robot engagement in human-robot interactions and their dependence on robotics knowledge , 2014, Robotics Auton. Syst..