Coordination Dynamics in Multi-human Multi-robot Teams

As robots enter human environments, they will be expected to collaborate and coordinate their actions with people. In order for robots to become more fluent at this, particularly in groups, robots must be able to recognize, understand, and anticipate coordinated human activities. However, how robots engage in this process can influence the dynamics of the team, particularly in multi-human, multi-robot situations. In this paper, we investigate how the presence of robots affects group coordination when both the anticipation algorithms they employ and their number (single robot or multi-robot) vary. Our results suggest that group coordination is significantly affected when a robot joins a human-only group, and is further affected when a second robot joins the group and employs a different anticipation algorithm from the other robot. These findings suggest that heterogeneous behavior of robots in a multi-human group can play a major role in how group coordination dynamics stabilize (or fail to), and may have implications for how we design future human-robot teams.

[1]  Atsushi Nakazawa,et al.  Learning from Observation Paradigm: Leg Task Models for Enabling a Biped Humanoid Robot to Imitate Human Dances , 2007, Int. J. Robotics Res..

[2]  Laurel D. Riek,et al.  Joint action perception to enable fluent human-robot teamwork , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[3]  Laurel D. Riek,et al.  A Method for Automatic Detection of Psychomotor Entrainment , 2016, IEEE Transactions on Affective Computing.

[4]  Tetsuo Ono,et al.  Body Movement Analysis of Human-Robot Interaction , 2003, IJCAI.

[5]  Cynthia Breazeal,et al.  Cost-Based Anticipatory Action Selection for Human–Robot Fluency , 2007, IEEE Transactions on Robotics.

[6]  Ayanna M. Howard,et al.  Understanding a child's play for robot interaction by sequencing play primitives using Hidden Markov Models , 2010, 2010 IEEE International Conference on Robotics and Automation.

[7]  Kazuhiro Kosuge,et al.  Dance Step Estimation Method Based on HMM for Dance Partner Robot , 2007, IEEE Transactions on Industrial Electronics.

[8]  Julie A. Shah,et al.  Human-robot co-navigation using anticipatory indicators of human walking motion , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[9]  Julie A. Shah,et al.  Fast target prediction of human reaching motion for cooperative human-robot manipulation tasks using time series classification , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[10]  Aaron F. Bobick,et al.  Anticipating human actions for collaboration in the presence of task and sensor uncertainty , 2014, 2014 IEEE International Conference on Robotics and Automation (ICRA).

[11]  Michael Beetz,et al.  A Self-Training Approach for Visual Tracking and Recognition of Complex Human Activity Patterns , 2012, International Journal of Computer Vision.

[12]  Lynne E. Parker,et al.  4-dimensional local spatio-temporal features for human activity recognition , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[13]  Laurel D. Riek,et al.  Movement Coordination in Human–Robot Teams: A Dynamical Systems Approach , 2016, IEEE Transactions on Robotics.

[14]  Michael J. Richardson,et al.  Effects of visual and verbal interaction on unintentional interpersonal coordination. , 2005, Journal of experimental psychology. Human perception and performance.

[15]  Dana Kulic,et al.  Discriminative functional analysis of human movements , 2013, Pattern Recognit. Lett..

[16]  Michael J. Richardson,et al.  Effects of movement stability and congruency on the emergence of spontaneous interpersonal coordination , 2011, Experimental Brain Research.

[17]  Yiannis Demiris,et al.  Adaptive human-robot interaction in sensorimotor task instruction: From human to robot dance tutors , 2014, Robotics Auton. Syst..

[18]  Bilge Mutlu,et al.  Coordination Mechanisms in Human-Robot Collaboration , 2013 .

[19]  Guy Hoffman,et al.  Gesture-based human-robot Jazz improvisation , 2010, 2010 IEEE International Conference on Robotics and Automation.

[20]  Hema Swetha Koppula,et al.  Learning Spatio-Temporal Structure from RGB-D Videos for Human Activity Detection and Anticipation , 2013, ICML.

[21]  Sandra Hirche,et al.  Synchronization in a goal-directed task: Human movement coordination with each other and robotic partners , 2011, 2011 RO-MAN.

[22]  Stefanos Nikolaidis,et al.  Optimization of Temporal Dynamics for Adaptive Human-Robot Interaction in Assembly Manufacturing , 2012, Robotics: Science and Systems.

[23]  Crystal Chao,et al.  Timing in multimodal turn-taking interactions , 2012, HRI 2012.

[24]  Michael J. Richardson,et al.  Measuring group synchrony: a cluster-phase method for analyzing multivariate movement time-series , 2012, Front. Physio..

[25]  Marek P. Michalowski,et al.  A dancing robot for rhythmic social interaction , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[26]  Peter E. Keller,et al.  The ADaptation and Anticipation Model (ADAM) of sensorimotor synchronization , 2013, Front. Hum. Neurosci..

[27]  Siddhartha S. Srinivasa,et al.  Legibility and predictability of robot motion , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Siddhartha S. Srinivasa,et al.  Using spatial and temporal contrast for fluent robot-human hand-overs , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  L. Riek,et al.  Tempo Adaptation and Anticipation Methods for Human-Robot Teams , 2016 .

[30]  Juan Fasola,et al.  A socially assistive robot exercise coach for the elderly , 2013, J. Hum. Robot Interact..

[31]  S. Hirche,et al.  Rhythm Patterns Interaction - Synchronization Behavior for Human-Robot Joint Action , 2014, PloS one.

[32]  Cynthia Breazeal,et al.  Effects of anticipatory perceptual simulation on practiced human-robot tasks , 2010, Auton. Robots.