Discovering SOCIABLE: Using a Conceptual Model to Evaluate the Legibility and Effectiveness of Backchannel Cues in an Entertainment Scenario

Robots are expected to become part of everyday life. However, while there have been important breakthroughs during the recent decades in terms of technological advances, the ability of robots to interact with humans intuitively and effectively is still an open challenge.In this paper, we aim to evaluate how humans interpret and leverage backchannel cues exhibited by a robot which interacts with them in an entertainment context. To do so, a conceptual model was designed to investigate the legibility and the effectiveness of a designed social cue, called SOCial ImmediAcy BackchanneL cuE (SOCIABLE), on participant’s performance. In addition, user’s attitude and cognitive capability were integrated into the model as an estimator of participants’ motivation and ability to process the cue. In working toward such a goal, we conducted a two-day long user study (N=114) at an international event with untrained participants who were not aware of the social cue the robot was able to provide. The results showed that participants were able to perceive the social signal generated from SOCIABLE and thus, they benefited from it. Our findings provide some important insights for the design of effective and instantaneous backchannel cues and the methodology for evaluating them in social robots.

[1]  Sofiane Boucenna,et al.  Evaluating the Engagement with Social Robots , 2015, International Journal of Social Robotics.

[2]  Olivia B. Newton,et al.  Effects of Social Cues on Social Signals in Human-Robot Interaction During a Hallway Navigation Task , 2018, Proceedings of the Human Factors and Ergonomics Society Annual Meeting.

[3]  Carme Torras,et al.  Short-Term Human–Robot Interaction Adaptability in Real-World Environments , 2020, Int. J. Soc. Robotics.

[4]  Jaap Ham,et al.  Combining Robotic Persuasive Strategies: The Persuasive Power of a Storytelling Robot that Uses Gazing and Gestures , 2015, Int. J. Soc. Robotics.

[5]  Michael Neff,et al.  A Verbal and Gestural Corpus of Story Retellings to an Expressive Embodied Virtual Character , 2016, LREC.

[6]  George Kanawaty,et al.  Introduction to work study , 1992 .

[7]  Carme Torras,et al.  Natural Teaching of Robot-Assisted Rearranging Exercises for Cognitive Training , 2019, ICSR.

[8]  Maya Cakmak,et al.  Characterizing the Design Space of Rendered Robot Faces , 2018, 2018 13th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[9]  Håkan Eftring,et al.  Case Report: Implications of Doing Research on Socially Assistive Robots in Real Homes , 2017, International Journal of Social Robotics.

[10]  Travis J. Wiltshire,et al.  Toward understanding social cues and signals in human–robot interaction: effects of robot gaze and proxemic behavior , 2013, Front. Psychol..

[11]  Gisele Ragusa,et al.  Long-Term Personalization of an In-Home Socially Assistive Robot for Children With Autism Spectrum Disorders , 2019, Front. Robot. AI.

[12]  A. Hayes.  Introduction to Mediation, Moderation, and Conditional Process Analysis: A Regression-Based Approach , 2013 .

[13]  Iina Aaltonen,et al.  Robot acceptance model for care (RAM-care): A principled approach to the intention to use care robots , 2020, Inf. Manag..

[14]  Bilge Mutlu,et al.  Designing persuasive robots: How robots might persuade people using vocal and nonverbal cues , 2012, 2012 7th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[15]  Stephen M. Fiore,et al.  Varying Social Cue Constellations Results in Different Attributed Social Signals in a Simulated Surveillance Task , 2015, FLAIRS.

[16]  Will M. Gervais,et al.  Analytic Thinking Promotes Religious Disbelief , 2012, Science.

[17]  Xianggui Qu,et al.  Multivariate Data Analysis , 2007, Technometrics.

[18]  Matthew S. Fritz,et al.  PSYCHOLOGICAL SCIENCE Research Article Required Sample Size to Detect the Mediated Effect , 2022 .

[19]  Brigitte Le Pévédic,et al.  Study of the Importance of Adequacy to Robot Verbal and Non Verbal Communication in Human-Robot interaction , 2012, ArXiv.

[20]  Maciel Prediger,et al.  How store flyers design affect perceived variety of retailers' assortment , 2019, Ind. Manag. Data Syst..

[21]  Johan Hagelbäck,et al.  Physiological Affect and Performance in a Collaborative Serious Game Between Humans and an Autonomous Robot , 2018, ICEC.

[22]  Henri Barki,et al.  Measuring User Participation, User Involvement, and User Attitude , 1994, MIS Q..

[23]  S. Beatty,et al.  External Search Effort: An Investigation across Several Product Categories , 1987 .

[24]  Carme Torras,et al.  Cognitive System Framework for Brain-Training Exercise Based on Human-Robot Interaction , 2020, Cognitive Computation.

[25]  Alexander Maedche,et al.  A Taxonomy of Social Cues for Conversational Agents , 2019, Int. J. Hum. Comput. Stud..

[26]  Florian Jentsch,et al.  Effects of Robotic Social Cues on Interpersonal Attributions and Assessments of Robot Interaction Behaviors , 2015 .

[27]  Franziska Marquart,et al.  Communication and persuasion : central and peripheral routes to attitude change , 1988 .

[28]  Mary-Anne Williams,et al.  Social Robotics , 2012, Lecture Notes in Computer Science.

[29]  I. Ajzen,et al.  Understanding Attitudes and Predicting Social Behavior , 1980 .

[30]  David G. Rand,et al.  Lazy, not biased: Susceptibility to partisan fake news is better explained by lack of reasoning than by motivated reasoning , 2019, Cognition.

[31]  H. Simon,et al.  A Behavioral Model of Rational Choice , 1955 .

[32]  G. Gigerenzer,et al.  Intuitive and Deliberate Judgments Are Based on Common Principles This Article Has Been Corrected. See Last Page , 2022 .

[33]  Dirk Heylen,et al.  Social Signal Processing: The Research Agenda , 2011, Visual Analysis of Humans.

[34]  Cynthia Breazeal,et al.  A Model-Free Affective Reinforcement Learning Approach to Personalization of an Autonomous Social Robot Companion for Early Literacy Education , 2019, AAAI.

[35]  Ana Paiva,et al.  Explainable Agents Through Social Cues: A Review , 2020, ArXiv.

[36]  Jonathan Evans.  Intuition and Reasoning: A Dual-Process Perspective , 2010 .

[37]  Jonathan Evans,et al.  Science Perspectives on Psychological , 2022 .

[38]  Tony Belpaeme,et al.  Nonverbal Immediacy as a Characterisation of Social Behaviour for Human–Robot Interaction , 2016, International Journal of Social Robotics.

[39]  Ben J. A. Kröse,et al.  Assessing Acceptance of Assistive Social Agent Technology by Older Adults: the Almere Model , 2010, Int. J. Soc. Robotics.

[40]  Peter M. Todd,et al.  Fast and frugal heuristics for environmentally bounded minds , 2001 .

[41]  Maja J. Mataric,et al.  Using Socially Assistive Human–Robot Interaction to Motivate Physical Exercise for Older Adults , 2012, Proceedings of the IEEE.

[42]  Danilo De Rossi,et al.  Towards a Believable Social Robot , 2013, Living Machines.

[43]  Valerie A. Thompson,et al.  Intuition, reason, and metacognition , 2011, Cognitive Psychology.

[44]  Maja Pantic,et al.  Social signal processing: Survey of an emerging domain , 2009, Image Vis. Comput..

[45]  Balbir S. Dhillon,et al.  Methods for performing human reliability and error analysis in health care , 2003 .