A Systematic Review of Ten Years of Research on Human Interaction with Social Robots

ABSTRACT While research and development related to robotics has been going on for decades, the past decade in particular has seen a marked increase in related efforts, in part due to technological advances, increased technological accessibility and reliability, and increased commercial availability. What have come to be known as social robots are now being used to explore novel forms of human-robot interaction, to understand social norms, and to test expectations and human responses. To capture the contributions of these research efforts, identify the current trends, and future directions, we systematically review 10 years of research in the field of social robotics between 2008 and 2018, which includes 86 publications with 70 user studies. We classify the past work based on the research topics and application areas, and provide information about the publications, their user studies, and the capabilities of the social robots utilized. We also discuss selected papers in detail and outline overall trends. Based on these findings, we identify some areas of potential future research.

[1]  Atsuo Takanishi,et al.  Design of the humanoid robot KOBIAN - preliminary analysis of facial and whole body emotion expression capabilities- , 2008, Humanoids 2008 - 8th IEEE-RAS International Conference on Humanoid Robots.

[2]  Robin R. Murphy,et al.  A preliminary model for comfortable approach distance based on environmental conditions and personal factors , 2012, 2012 International Conference on Collaboration Technologies and Systems (CTS).

[3]  Brian Scassellati,et al.  Personalizing Robot Tutors to Individuals’ Learning Differences , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  David Whitney,et al.  Communicating Robot Arm Motion Intent Through Mixed Reality Head-mounted Displays , 2017, ISRR.

[5]  Mathias Funk,et al.  IdleBot: Exploring Non-Engaging Interaction Design in Personal Spaces , 2018, CHI Extended Abstracts.

[6]  Rajiv Khosla,et al.  Socially Assistive Robots in Elderly Care: A Mixed-Method Systematic Literature Review , 2014, Int. J. Hum. Comput. Interact..

[7]  Robin R. Murphy,et al.  Survey of Non-facial/Non-verbal Affective Expressions for Appearance-Constrained Robots , 2008, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[8]  Jamy Li Social robots as interactive technology agents: Supporting design with exploratory assessment , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  L. Billeci,et al.  Autism and social robotics: A systematic review , 2016, Autism research : official journal of the International Society for Autism Research.

[10]  Cynthia Breazeal,et al.  The huggable: a platform for research in robotic companions for pediatric care , 2009, IDC.

[11]  Kun Xu,et al.  A Systematic Review of the Personality of Robot: Mapping Its Conceptualization, Operationalization, Contextualization and Effects , 2019, Int. J. Hum. Comput. Interact..

[12]  Guy Hoffman,et al.  Robotic experience companionship in music listening and video watching , 2015, Personal and Ubiquitous Computing.

[13]  Cynthia Breazeal,et al.  TOFU: a socially expressive robot character for child interaction , 2009, IDC.

[14]  Damla Turgut,et al.  A Systematic Review of the Convergence of Augmented Reality, Intelligent Virtual Agents, and the Internet of Things , 2019, Artificial Intelligence in IoT.

[15]  Sonya S. Kwak,et al.  Can you touch me?: the impact of physical contact on emotional engagement with a robot , 2014, HAI.

[16]  Xuan Wang,et al.  Interactive Online Shopping with Personalized Robot Agent , 2018, IUI Companion.

[17]  GratchJonathan,et al.  It's only a computer , 2014 .

[18]  Sean Andrist,et al.  Look Like Me: Matching Robot Personality via Gaze to Increase Motivation , 2015, CHI.

[19]  Pamela J. Wisniewski,et al.  Mixed Reality Tabletop Gameplay: Social Interaction With a Virtual Human Capable of Physical Influence , 2019, IEEE Transactions on Visualization and Computer Graphics.

[20]  Jodi Forlizzi,et al.  Personalization in HRI: A longitudinal field experiment , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[21]  Gregory M. P. O'Hare,et al.  Using Mixed Reality Agents as Social Interfaces for Robots , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[22]  Frédéric Lerasle,et al.  Evaluations of embedded modules dedicated to multimodal human-robot interaction , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[23]  Cecilio Angulo,et al.  Emotional factors in robot-based assistive services for elderly at home , 2013, 2013 IEEE RO-MAN.

[24]  Loulin Huang,et al.  Bio-inspired therapeutic pet robots: Review and future direction , 2015, 2015 10th International Conference on Information, Communications and Signal Processing (ICICS).

[25]  Frank Steinicke,et al.  Excuse me! Perception of Abrupt Direction Changes Using Body Cues and Paths on Mixed Reality Avatars , 2018, HRI.

[26]  BenittiFabiane Barreto Vavassori Exploring the educational potential of robotics in schools , 2012 .

[27]  Helen Petrie,et al.  Older people and robotic technologies in the home: perspectives from recent research literature , 2017, PETRA.

[28]  Robbert-Jan Beun,et al.  A Remote Social Robot to Motivate and Support Diabetic Children in Keeping a Diary , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[29]  Kyle Johnsen,et al.  Mixed Reality Virtual Pets to Reduce Childhood Obesity , 2014, IEEE Transactions on Visualization and Computer Graphics.

[30]  Tony Belpaeme,et al.  Review of Semantic-Free Utterances in Social Human–Robot Interaction , 2016, Int. J. Hum. Comput. Interact..

[31]  Jorge Dias,et al.  Attentional Mechanisms for Socially Interactive Robots–A Survey , 2014, IEEE Transactions on Autonomous Mental Development.

[32]  Marcelo H. Ang,et al.  Why Robots? A Survey on the Roles and Benefits of Social Robots in the Therapy of Children with Autism , 2013, International Journal of Social Robotics.

[33]  Gregory M. P. O'Hare,et al.  Mixing robotic realities , 2006, IUI '06.

[34]  Catherine J. Stevens,et al.  A review of the applicability of robots in education , 2013 .

[35]  Kangsoo Kim,et al.  The effects of virtual human's spatial and behavioral coherence with physical objects on social presence in AR , 2017, Comput. Animat. Virtual Worlds.

[36]  Martin Wattenberg,et al.  Visualizing Dataflow Graphs of Deep Learning Models in TensorFlow , 2018, IEEE Transactions on Visualization and Computer Graphics.

[37]  Takayuki Nagai,et al.  Toward playmate robots that can play with children considering personality , 2014, HAI.

[38]  Liang-Yi Li,et al.  Researches on Using Robots in Education , 2009, Edutainment.

[39]  Guy Hoffman,et al.  Dumb robots, smart phones: A case study of music listening companionship , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[40]  Cindy L. Bethel,et al.  Therabot™: A Robotic Support Companion , 2018, HRI.

[41]  Pierre-Yves Oudeyer,et al.  Acroban the humanoid: playful and compliant physical child-robot interaction , 2010, SIGGRAPH '10.

[42]  Yiannis Demiris,et al.  Where is my keyboard? Model-based active adaptation of action-space in a humanoid robot , 2015, 2015 IEEE-RAS 15th International Conference on Humanoid Robots (Humanoids).

[43]  Omar Mubin,et al.  Adaptive Social Robot for Sustaining Social Engagement during Long-Term Children–Robot Interaction , 2017, Int. J. Hum. Comput. Interact..

[44]  Bertram F. Malle,et al.  What Does it Mean to Trust a Robot?: Steps Toward a Multidimensional Measure of Trust , 2018, HRI.

[45]  Gerd Bruder,et al.  Anticipating Widespread Augmented Reality: Insights from the 2018 AR Visioning Workshop , 2019 .

[46]  Peter Ford Dominey,et al.  DAC-h3: A Proactive Robot Cognitive Architecture to Acquire and Express Knowledge About the World and the Self , 2017, IEEE Transactions on Cognitive and Developmental Systems.

[47]  Louis-Philippe Morency,et al.  It's only a computer: Virtual humans increase willingness to disclose , 2014, Comput. Hum. Behav..

[48]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[49]  Christine K. Syriopoulou-Delli,et al.  Review of assistive technology in the training of children with autism spectrum disorders , 2020, International journal of developmental disabilities.

[50]  Fabiane Barreto Vavassori Benitti,et al.  Exploring the educational potential of robotics in schools: A systematic review , 2012, Comput. Educ..

[51]  Jon Carroll,et al.  Augmented reality gaming with sphero , 2013, SIGGRAPH '13.

[52]  Takayuki Kanda,et al.  Will People Keep the Secret of a Humanoid Robot?— Psychological Intimacy in HRI , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[53]  Arindam Dey,et al.  A Systematic Review of 10 Years of Augmented Reality Usability Studies: 2005 to 2014 , 2018, Front. Robot. AI.

[54]  Frank Biocca,et al.  Personality and facial expressions in human-robot interaction , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[55]  Pierre-Yves Oudeyer,et al.  The Impact of Human–Robot Interfaces on the Learning of Visual Objects , 2013, IEEE Transactions on Robotics.

[56]  Nagisa Munekata,et al.  Robots that can feel the mood: Contexet-aware behaviors in accordance with the activity of communications , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[57]  Samuel Spaulding Personalized Robot Tutors that Learn from Multimodal Data , 2018, AAMAS.

[58]  Goldie Nejat,et al.  How Robots Influence Humans: A Survey of Nonverbal Communication in Social Human–Robot Interaction , 2019, International Journal of Social Robotics.

[59]  Bruce A. MacDonald,et al.  The Role of Healthcare Robots for Older People at Home: A Review , 2014, Int. J. Soc. Robotics.

[60]  Jörg Stückler,et al.  Mobile Teleoperation Interfaces with Adjustable Autonomy for Personal Service Robots , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[61]  Kangsoo Kim,et al.  Revisiting Trends in Augmented Reality Research: A Review of the 2nd Decade of ISMAR (2008–2017) , 2018, IEEE Transactions on Visualization and Computer Graphics.

[62]  Leila Takayama,et al.  Help me help you: Interfaces for personal robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[63]  Danica Kragic,et al.  A Comparison of Visualisation Methods for Disambiguating Verbal Requests in Human-Robot Interaction , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[64]  Tijs Vandemeulebroucke,et al.  How do older adults experience and perceive socially assistive robots in aged care: a systematic review of qualitative evidence , 2018, Aging & mental health.

[65]  Dana Kulic,et al.  Measurement Instruments for the Anthropomorphism, Animacy, Likeability, Perceived Intelligence, and Perceived Safety of Robots , 2009, Int. J. Soc. Robotics.

[66]  Kangsoo Kim,et al.  Walking Your Virtual Dog: Analysis of Awareness and Proxemics with Simulated Support Animals in Augmented Reality , 2019, 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR).

[67]  Maja J. Mataric,et al.  Month-long, In-home Case Study of a Socially Assistive Robot for Children with Autism Spectrum Disorder , 2018, HRI.

[68]  Jeremy N. Bailenson,et al.  A Large-Scale Study of Surrogate Physicality and Gesturing on Human–Surrogate Interactions in a Public Space , 2017, Front. Robot. AI.

[69]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[70]  Joonhwan Lee,et al.  Robots in Diverse Contexts: Effects of Robots Tasks on Expected Personality , 2018, HRI.

[71]  Leila Takayama,et al.  Judging a bot by its cover: An experiment on expectation setting for personal robots , 2010, 2010 5th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[72]  Vicki Bruce What the human face tells the human mind: some challenges for the robot-human interface , 1993, Adv. Robotics.

[73]  Siddhartha S. Srinivasa,et al.  Effects of robot capability on user acceptance , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[74]  Hannes Ritschel,et al.  Socially-Aware Reinforcement Learning for Personalized Human-Robot Interaction , 2018, AAMAS.

[75]  Takayuki Kanda,et al.  A conversational robot in an elderly care center: An ethnographic study , 2011, 2011 6th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[76]  Astrid Weiss,et al.  Don't stand so close to me: Users' attitudinal and behavioral responses to personal space invasion by robots , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[77]  Wendy Ju,et al.  Social robots for automated remote instruction , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[78]  Emily S. Cross,et al.  The Perception of Emotion in Artificial Agents , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[79]  Matthias Scheutz,et al.  Sacrifice One For the Good of Many? People Apply Different Moral Norms to Human and Robot Agents , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[80]  Atsuo Takanishi,et al.  Whole body emotion expressions for KOBIAN humanoid robot — preliminary experiments with different Emotional patterns — , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[81]  Torbjørn S. Dahl,et al.  Robots in Health and Social Care: A Complementary Technology to Home Care and Telehealthcare? , 2013, Robotics.

[82]  Yiannis Demiris,et al.  Lifelong Augmentation of Multimodal Streaming Autobiographical Memories , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[83]  Karrie Karahalios,et al.  You can't always sketch what you want: Understanding Sensemaking in Visual Query Systems , 2017, IEEE Transactions on Visualization and Computer Graphics.

[84]  Mohammad Obaid,et al.  Investigating Design Implications Towards a Social Robot as a Memory Trainer , 2017, HAI.

[85]  Huosheng Hu,et al.  Robotic Dance in Social Robotics—A Taxonomy , 2015, IEEE Transactions on Human-Machine Systems.

[86]  Gerald Bieber,et al.  Perspectives on Social Robots: From the Historic Background to an Experts' View on Future Developments , 2018, PETRA.

[87]  D. Moher,et al.  Nonalcoholic Fatty Liver Disease and Acute Ischemic Stroke , 2010 .

[88]  D PickardMatthew,et al.  Revealing sensitive information in personal interviews , 2016 .

[89]  Yan Zhang,et al.  Philos: a sociable robot for human robot interactions and wireless health monitoring , 2012, SAC '12.

[90]  Yael Edan,et al.  Toward Socially Aware Person-Following Robots , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[91]  Bruce A. MacDonald,et al.  Acceptance of Healthcare Robots for the Older Population: Review and Future Directions , 2009, Int. J. Soc. Robotics.

[92]  Cindy L. Bethel,et al.  A Survey of Using Vocal Prosody to Convey Emotion in Robot Speech , 2016, Int. J. Soc. Robotics.

[93]  Brian Scassellati,et al.  Fostering Learning Gains Through Personalized Robot-Child Tutoring Interactions , 2015, HRI.

[94]  Steven J. Stroessner,et al.  The Robotic Social Attributes Scale (RoSAS): Development and Validation , 2017, 2017 12th ACM/IEEE International Conference on Human-Robot Interaction (HRI.

[95]  Guy Hoffman,et al.  Machines as a source of consolation: Robot responsiveness increases human approach behavior and desire for companionship , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[96]  Lucas Paletta,et al.  AMIGO: Towards Social Robot based Motivation for Playful Multimodal Intervention in Dementia , 2018, PETRA.

[97]  Kangsoo Kim,et al.  A Systematic Survey of 15 Years of User Studies Published in the Intelligent Virtual Agents Conference , 2018, IVA.

[98]  Ben J. A. Kröse,et al.  Measuring the influence of social abilities on acceptance of an interface robot and a screen agent by elderly users , 2009, BCS HCI.

[99]  Alberto Sanna,et al.  Robotic companion for diabetic children: emotional and educational support to diabetic children, through an interactive robot , 2012, IDC '12.

[100]  Elisabeth André,et al.  Real-Time Robot Personality Adaptation based on Reinforcement Learning and Social Signals , 2017, HRI.

[101]  Takayuki Kanda,et al.  How to approach humans?-strategies for social robots to initiate interaction , 2009, 2009 4th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[102]  Aaron Steinfeld,et al.  Inducing Bystander Interventions During Robot Abuse with Social Mechanisms , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[103]  Geri Gay,et al.  Caring for Mobile Phone-Based Virtual Pets can Influence Youth Eating Behaviors , 2012 .

[104]  Justin Dauwels,et al.  Perception of Humanoid Social Mediator in Two-Person Dialogs , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[105]  Tamami Saga,et al.  Daily support robots that move on the body , 2014, HAI.

[106]  Cynthia Breazeal,et al.  Human social response toward humanoid robot's head and facial features , 2010, CHI Extended Abstracts.

[107]  Vicky Charisi,et al.  Evaluation methods for user-centered child-robot interaction , 2016, 2016 25th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[108]  J. Ioannidis,et al.  The PRISMA Statement for Reporting Systematic Reviews and Meta-Analyses of Studies That Evaluate Health Care Interventions: Explanation and Elaboration , 2009, Annals of Internal Medicine [serial online].

[109]  Allison M. Okamura,et al.  Medical and Health-Care Robotics , 2010, IEEE Robotics & Automation Magazine.

[110]  Sonya S. Kwak,et al.  Are You Embarrassed?: The Impact of Robot Types on Emotional Engagement with a Robot , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[111]  Adriana Tapus,et al.  A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[112]  Yixing Chen,et al.  Revealing sensitive information in personal interviews: Is self-disclosure easier with humans or avatars and under what conditions? , 2016, Comput. Hum. Behav..

[113]  Stephen R. H. Langton,et al.  How the eyes affect the I: gaze perception, cognition and the robot-human interface , 2001, Proceedings 10th IEEE International Workshop on Robot and Human Interactive Communication. ROMAN 2001 (Cat. No.01TH8591).

[114]  Justine Cassell,et al.  Field Trial Analysis of Socially Aware Robot Assistant , 2018, AAMAS.

[115]  Guillaume Dubuisson Duplessis,et al.  Behavioral and Emotional Spoken Cues Related to Mental States in Human-Robot Social Interaction , 2015, ICMI.

[116]  Jelle Saldien,et al.  Demonstration of OPSORO - an open platform for social robots , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[117]  Wendy A. Rogers,et al.  Investigating healthcare providers' acceptance of personal robots for assisting with daily caregiving tasks , 2013, CHI Extended Abstracts.