Adapting Movements and Behaviour to Favour Communication in Human-Robot Interaction

In this chapter we are presenting an overview on how adaptation of movement and behaviour can favour communication in Human-Robot Interaction (HRI). A model of a communication space based on a action-reaction classification is presented. Past research in HRI is presented for verbal, non-verbal and adaptation of communication. Further, the influence of human aware navigation is discussed and concepts like proxemics, path planing and robot motion are presented. The chapter discusses possible explicated and implicated methods of adaptation as well as it is identifying interruption concepts for communication.

[1]  Dare A. Baldwin,et al.  Acoustic Packaging: Maternal Speech and Action Synchrony , 2011, IEEE Transactions on Autonomous Mental Development.

[2]  Clifford Nass,et al.  The media equation - how people treat computers, television, and new media like real people and places , 1996 .

[3]  Mark Steedman,et al.  Object-Action Complexes: Grounded abstractions of sensory-motor processes , 2011, Robotics Auton. Syst..

[4]  Darwin G. Caldwell,et al.  Learning and Reproduction of Gestures by Imitation , 2010, IEEE Robotics & Automation Magazine.

[5]  Wolfram Burgard,et al.  Experiences with an Interactive Museum Tour-Guide Robot , 1999, Artif. Intell..

[6]  Alex Pentland,et al.  Social signals, their function, and automatic analysis: a survey , 2008, ICMI '08.

[7]  Manuel Giuliani,et al.  How can i help you': comparing engagement classification strategies for a robot bartender , 2013, ICMI '13.

[8]  Chrystopher L. Nehaniv,et al.  Temporal emphasis for goal extraction in task demonstration to a humanoid robot by naive users , 2013, 2013 IEEE Third Joint International Conference on Development and Learning and Epigenetic Robotics (ICDL).

[9]  Reid G. Simmons,et al.  Socially-appropriate approach paths using human data , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[10]  Kerstin Fischer,et al.  Tutor Spotter: Proposing a Feature Set and Evaluating It in a Robotic System , 2011, International Journal of Social Robotics.

[11]  S. Duck.  Human Relationships , 1991 .

[12]  Eric Horvitz,et al.  Dialog in the open world: platform and applications , 2009, ICMI-MLMI '09.

[13]  Joel Krueger.  Extended cognition and the space of social interaction , 2011, Consciousness and Cognition.

[14]  Tony Belpaeme,et al.  Nonverbal Immediacy as a Characterisation of Social Behaviour for Human–Robot Interaction , 2016, International Journal of Social Robotics.

[15]  Emrah Akin Sisbot.  Towards human-aware robot motions , 2008 .

[16]  Henry Been-Lirn Duh,et al.  A Simulation of Bonding Effects and Their Impacts on Pedestrian Dynamics , 2010, IEEE Transactions on Intelligent Transportation Systems.

[17]  William D. Smart,et al.  Layered costmaps for context-sensitive navigation , 2014, 2014 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[18]  Anca D. Dragan,et al.  Learning from Physical Human Corrections, One Feature at a Time , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Sonia Chernova,et al.  Temporal Models for Robot Classification of Human Interruptibility , 2017, AAMAS.

[20]  ChangHwan Kim,et al.  A 3D-grasp synthesis algorithm to grasp unknown objects based on graspable boundary and convex segments , 2015, Inf. Sci..

[21]  E. Hall,et al.  The Hidden Dimension , 1970 .

[22]  Gonzalo Ferrer,et al.  Robot social-aware navigation framework to accompany people walking side-by-side , 2016, Autonomous Robots.

[23]  Thomas Bak,et al.  Adaptive human aware navigation based on motion pattern analysis , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[24]  Rachid Alami,et al.  A framework towards a socially aware Mobile Robot motion in Human-Centered dynamic environment , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[25]  Elena Torta,et al.  Design of Robust Robotic Proxemic Behaviour , 2011, ICSR.

[26]  Marc Hanheide,et al.  Show me your moves! Conveying navigation intention of a mobile robot to humans , 2015, 2015 European Conference on Mobile Robots (ECMR).

[27]  A. Anderson,et al.  The Effects of Visibility on Dialogue and Performance in a Cooperative Problem Solving Task , 1994 .

[28]  Subramanian Ramamoorthy,et al.  Towards robust grasps: Using the environment semantics for robotic object affordances , 2018, AAAI 2018.

[29]  Horst-Michael Groß,et al.  Approaching a Person in a Socially Acceptable Manner Using a Fast Marching Planner , 2011, ICIRA.

[30]  Alberto Sanfeliu,et al.  Local optimization of cooperative robot movements for guiding and regrouping people in a guiding mission , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[31]  Stuart M. Allen,et al.  Interruptibility prediction for ubiquitous systems: conventions and new directions from a growing field , 2015, UbiComp.

[32]  Chyi-Yeu Lin,et al.  Visualization of Facial Expression Deformation Applied to the Mechanism Improvement of Face Robot , 2013, Int. J. Soc. Robotics.

[33]  Yuichiro Yoshikawa,et al.  How Should a Robot Interrupt a Conversation Between Multiple Humans , 2018, ICSR.

[34]  D. Helbing,et al.  The Walking Behaviour of Pedestrian Social Groups and Its Impact on Crowd Dynamics , 2010, PloS one.

[35]  Christian Laugier,et al.  From Proxemics Theory to Socially-Aware Navigation: A Survey , 2014, International Journal of Social Robotics.

[36]  Takayuki Kanda,et al.  Navigation for human-robot interaction tasks , 2004, IEEE International Conference on Robotics and Automation, 2004. Proceedings. ICRA '04. 2004.

[37]  H. Kuzuoka,et al.  Reconfiguring spatial formation arrangement by robot body orientation , 2010, HRI 2010.

[38]  Ana Paiva,et al.  Modelling Empathy in Social Robotic Companions , 2011, UMAP Workshops.

[39]  Rachid Alami,et al.  A step towards a sociable robot guide which monitors and adapts to the person's activities , 2009, 2009 International Conference on Advanced Robotics.

[40]  Leila Takayama,et al.  Influences on proxemic behaviors in human-robot interaction , 2009, 2009 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Tony Belpaeme,et al.  People Interpret Robotic Non-linguistic Utterances Categorically , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[42]  Emer Gilmartin,et al.  Multimodal conversational interaction with a humanoid robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[43]  Marc Hanheide,et al.  Qualitative constraints for human-aware robot navigation using Velocity Costmaps , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[44]  Takayuki Kanda,et al.  Does the Design of a Robot Influence Its Animacy and Perceived Intelligence? , 2009, Int. J. Soc. Robotics.

[45]  M. Holland,et al.  Blinking and Mental Load , 1972, Psychological reports.

[46]  Henrik I. Christensen,et al.  Human-robot embodied interaction in hallway settings: a pilot user study , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[47]  Rachid Alami,et al.  Rackham: An Interactive Robot-Guide , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[48]  Edoardo Ardizzone,et al.  Experiences with CiceRobot, a Museum Guide Cognitive Robot , 2005, AI*IA.

[49]  John Travis Butler,et al.  Psychological Effects of Behavior Patterns of a Mobile Personal Robot , 2001, Auton. Robots.

[50]  A. Feingold.  Good-looking people are not what we think. , 1992 .

[51]  Peter K. Allen,et al.  Robot learning of everyday object manipulations via human demonstration , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[52]  Michael A. Arbib,et al.  Learning to grasp and extract affordances: the Integrated Learning of Grasps and Affordances (ILGA) model , 2015, Biological Cybernetics.

[53]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[54]  Nathaniel P. Grove,et al.  Measuring Load on Working Memory: The Use of Heart Rate as a Means of Measuring Chemistry Students' Cognitive Load , 2014 .

[55]  Ronald P. A. Petrick,et al.  Learning Grasp Affordance Reasoning Through Semantic Relations , 2019, IEEE Robotics and Automation Letters.

[56]  Marco Costa,et al.  Interpersonal Distances in Group Walking , 2010 .

[57]  Ron Alterovitz,et al.  Demonstration-Guided Motion Planning , 2011, ISRR.

[58]  Joseph S. Valacich,et al.  AIS Electronic , 2022 .

[59]  Noam Chomsky,et al.  The faculty of language: what is it, who has it, and how did it evolve? , 2002 .

[60]  S. Schaal.  Dynamic Movement Primitives -A Framework for Motor Control in Humans and Humanoid Robotics , 2006 .

[61]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[62]  Neville Hogan,et al.  Impedance Control: An Approach to Manipulation: Part II—Implementation , 1985 .

[63]  Li Fei-Fei,et al.  Reasoning about Object Affordances in a Knowledge Base Representation , 2014, ECCV.

[64]  Catherine J. Stevens,et al.  Don’t Stare at Me: The Impact of a Humanoid Robot’s Gaze upon Trust During a Cooperative Human–Robot Visual Task , 2017, Int. J. Soc. Robotics.

[65]  John D. Bransford,et al.  Gender Representation and Humanoid Robots Designed for Domestic Use , 2009, Int. J. Soc. Robotics.

[66]  Omar Mubin,et al.  Emotion and Memory Model to Promote Mathematics Learning - An Exploratory Long-term Study , 2018, HAI.

[67]  Takayuki Kanda,et al.  May I help you? - Design of Human-like Polite Approaching Behavior- , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[68]  Takayuki Kanda,et al.  How to approach humans?-strategies for social robots to initiate interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[69]  J. Watson,et al.  Early socio–emotional development: Contingency perception and the social-biofeedback model. , 1999 .

[70]  Sonia Chernova,et al.  Recent Advances in Robot Learning from Demonstration , 2020, Annu. Rev. Control. Robotics Auton. Syst..

[71]  Ashutosh Saxena,et al.  Deep multimodal embedding: Manipulating novel objects with point-clouds, language and trajectories , 2015, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[72]  Maja J. Matarić,et al.  Robots have needs too , 2016 .

[73]  Willem F. G. Haselager,et al.  Do Robot Performance and Behavioral Style a ↵ ect Human Trust ? A Multi-Method Approach , 2014 .

[74]  J. Uleman,et al.  Spontaneous inferences, implicit impressions, and implicit theories. , 2008, Annual review of psychology.

[75]  Jürgen Pripfl,et al.  Lessons learned from the deployment of a long-term autonomous robot as companion in physical therapy for older adults with dementia a mixed methods study , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[76]  Woojin Chung,et al.  Safe Navigation of a Mobile Robot Considering Visibility of Environment , 2009, IEEE Transactions on Industrial Electronics.

[77]  L. Schillingmann,et al.  A Computational Model of Acoustic Packaging , 2009, IEEE Transactions on Autonomous Mental Development.

[78]  Tamim Asfour,et al.  Programming by demonstration: dual-arm manipulation tasks for humanoid robots , 2004, 2004 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) (IEEE Cat. No.04CH37566).

[79]  Alexandra Kirsch,et al.  Influence of legibility on perceived safety in a virtual human-robot path crossing task , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[80]  F. Paas,et al.  Cognitive Architecture and Instructional Design , 1998 .

[81]  Sofiane Boucenna,et al.  Evaluating the Engagement with Social Robots , 2015, International Journal of Social Robotics.

[82]  M. Tomasello.  Origins of human communication , 2008 .

[83]  Donn Byrne,et al.  An Overview (and Underview) of Research and Theory within the Attraction Paradigm , 1997 .

[84]  Aude Billard,et al.  Combining Dynamical Systems control and programming by demonstration for teaching discrete bimanual coordination tasks to a humanoid robot , 2008, 2008 3rd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[85]  Bilge Mutlu,et al.  Human-robot proxemics: Physical and psychological distancing in human-robot interaction , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[86]  Henrik I. Christensen,et al.  Evaluation of Passing Distance for Social Robots , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[87]  Wolfram Burgard,et al.  Probabilistic Algorithms and the Interactive Museum Tour-Guide Robot Minerva , 2000, Int. J. Robotics Res..

[88]  William D. Smart,et al.  Tuning Cost Functions for Social Navigation , 2013, ICSR.

[89]  Yang Wang,et al.  Multimodal behavior and interaction as indicators of cognitive load , 2012, TIIS.

[90]  Ronald P. A. Petrick,et al.  Reasoning on Grasp-Action Affordances , 2019, TAROS.

[91]  B. Oken,et al.  Sensitivity to mental effort and test–retest reliability of heart rate variability measures in healthy seniors , 2011, Clinical Neurophysiology.

[92]  Angelica Lim,et al.  Gaze and filled pause detection for smooth human-robot conversations , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[93]  Helen F. Hastie,et al.  Towards a Conversational Agent for Remote Robot-Human Teaming , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[94]  Michael N. Mistry,et al.  Learning Generalizable Coupling Terms for Obstacle Avoidance via Low-Dimensional Geometric Descriptors , 2019, IEEE Robotics and Automation Letters.

[95]  T. M. Ciolek,et al.  Environment and the Spatial Arrangement of Conversational Encounters , 1980 .

[96]  Takayuki Kanda,et al.  Walking together , 2012, HRI 2014.

[97]  Jun Nakanishi,et al.  Movement imitation with nonlinear dynamical systems in humanoid robots , 2002, Proceedings 2002 IEEE International Conference on Robotics and Automation (Cat. No.02CH37292).

[98]  Michael N. Mistry,et al.  Learning and Composing Primitive Skills for Dual-arm Manipulation , 2019, TAROS.

[99]  Stephen M. Haas,et al.  Measuring routine and strategic relational maintenance: Scale revision, sex versus gender roles, and the prediction of relational characteristics , 2000 .

[100]  Kerstin Dautenhahn,et al.  Social Roles and Baseline Proxemic Preferences for a Domestic Service Robot , 2014, Int. J. Soc. Robotics.

[101]  Nicole C. Krämer,et al.  The Effects of Humanlike and Robot-Specific Affective Nonverbal Behavior on Perception, Emotion, and Behavior , 2018, International Journal of Social Robotics.

[102]  Takayuki Kanda,et al.  How do people walk side-by-side? — Using a computational model of human behavior for a social robot , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[103]  Alessandra Sciutti,et al.  Co-development of Manner and Path Concepts in Language, Action, and Eye-Gaze Behavior , 2014, Top. Cogn. Sci..

[104]  Nick Campbell,et al.  Investigating the use of Non-verbal Cues in Human-Robot Interaction with a Nao robot , 2012, 2012 IEEE 3rd International Conference on Cognitive Infocommunications (CogInfoCom).

[105]  Omar Mubin,et al.  Adaptive Social Robot for Sustaining Social Engagement during Long-Term Children–Robot Interaction , 2017, Int. J. Hum. Comput. Interact..

[106]  Omar Mubin,et al.  A Systematic Review of Adaptivity in Human-Robot Interaction , 2017, Multimodal Technol. Interact..

[107]  Marc Hanheide,et al.  Hesitation Signals in Human-Robot Head-on Encounters : A Pilot Study , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[108]  Rachid Alami,et al.  Exploratory Study of a Robot Approaching a Person in the Context of Handing Over an Object , 2007, AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics.

[109]  Helge J. Ritter,et al.  Situated robot learning for multi-modal instruction and imitation of grasping , 2004, Robotics Auton. Syst..

[110]  Thierry Fraichard,et al.  An anthropomorphic navigation scheme for dynamic scenarios , 2011, 2011 IEEE International Conference on Robotics and Automation.

[111]  Illah R. Nourbakhsh,et al.  The mobot museum robot installations: a five year experiment , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[112]  F. Paas,et al.  Cognitive Load Measurement as a Means to Advance Cognitive Load Theory , 2003 .

[113]  Frank Broz,et al.  Gaze and Attention During an HRI Storytelling Task , 2015, HRI 2015.

[114]  R. Simmons,et al.  COMPANION: A Constraint-Optimizing Method for Person-Acceptable Navigation , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[115]  Roland Siegwart,et al.  Robox, a Remarkable Mobile Robot for the Real World , 2002, ISER.

[116]  Kerstin Dautenhahn,et al.  A long-term Human-Robot Proxemic study , 2011, 2011 RO-MAN.

[117]  M. Knapp,et al.  Nonverbal communication in human interaction , 1972 .

[118]  Timothy W. Bickmore,et al.  Establishing and maintaining long-term human-computer relationships , 2005, TCHI.

[119]  Goldie Nejat,et al.  Recognizing Emotional Body Language Displayed by a Human-like Social Robot , 2014, International Journal of Social Robotics.

[120]  Kerstin Fischer,et al.  The impact of the contingency of robot feedback on HRI , 2013, 2013 International Conference on Collaboration Technologies and Systems (CTS).

[121]  Haizhou Li,et al.  Making Social Robots More Attractive: The Effects of Voice Pitch, Humor and Empathy , 2013, Int. J. Soc. Robotics.

[122]  Frank Broz,et al.  Learning and Generalisation of Primitives Skills Towards Robust Dual-arm Manipulation , 2019, ArXiv.

[123]  Aude Billard,et al.  Reinforcement learning for imitating constrained reaching movements , 2007, Adv. Robotics.

[124]  Cindy L. Bethel,et al.  A Survey of Using Vocal Prosody to Convey Emotion in Robot Speech , 2016, Int. J. Soc. Robotics.

[125]  Sukeshini A. Grandhi,et al.  Technology-mediated interruption management , 2010, Int. J. Hum. Comput. Stud..

[126]  Rachid Alami,et al.  A Human Aware Mobile Robot Motion Planner , 2007, IEEE Transactions on Robotics.

[127]  Michael J. Spivey,et al.  The Continuity Of Mind , 2008 .

[128]  Rachid Alami,et al.  How may I serve you?: a robot companion approaching a seated person in a helping context , 2006, HRI '06.

[129]  Thomas Bak,et al.  Trajectory planning for robots in dynamic human environments , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[130]  Selma Sabanovic,et al.  Deriving Minimal Features for Human-Like Facial Expressions in Robotic Faces , 2014, International Journal of Social Robotics.

[131]  Kerstin Fischer,et al.  Contingency allows the robot to spot the tutor and to learn from interaction , 2011, 2011 IEEE International Conference on Development and Learning (ICDL).

[132]  Jamie Reilly,et al.  The human task-evoked pupillary response function is linear: Implications for baseline response scaling in pupillometry , 2018, Behavior Research Methods.