User-Adaptive Interaction in Social Robots: A Survey Focusing on Non-physical Interaction

This work presents a survey on the usage of user-adaptive techniques for human interface with Social Robots, with focus on non-physical interaction. The work is based on an analysis of a number of recent scientific works, and aims to uncover existing scientific and technological gaps which can serve as basis for future research and development work. User-adaptive systems consist of autonomous agents that are able to use some manner of information on their user in order to adapt to them. Through their adaptive nature, these systems have been shown to be easier to accept by end-users, and to lead to improvements in a myriad of objective and subjective performance measurements. Thus, in the context of a growing domestic Social Robot industry, it becomes of key importance to study the scientific and technological frontiers of this field. In order to uncover potential lines of future research, we propose a taxonomy for the classification of works, which we use to analyse the works under survey, exposing the current scientific frontiers of the area. Aiming to establish the overall readiness of the field, we also analyse the maturity of the works under survey, exposing the current technological level of the techniques at hand and discussing a number of technological challenges.

[1]  Horst-Michael Gross,et al.  OfficeMate-a Study of an Online Learning Dialog System for Mobile Assistive Robots , 2014 .

[2]  Antonis A. Argyros,et al.  Hobbit , a care robot supporting independent living at home : First prototype and lessons learned , 2015 .

[3]  Ana Paiva,et al.  Expressive Lights for Revealing Mobile Service Robot State , 2015, ROBOT.

[4]  Zhijun Zhang,et al.  Adaptive incremental learning of image semantics with application to social robot , 2016, Neurocomputing.

[5]  Lourdes Moreno,et al.  An approach to the integration of accessibility requirements into a user interface development method , 2014, Sci. Comput. Program..

[6]  Petros Maragos,et al.  The MOBOT Platform - Showcasing Multimodality in Human-Assistive Robot Interaction , 2016, HCI.

[7]  Milad Geravand,et al.  User-adaptive shared control in a mobility assistance robot based on human-centered intention reading and decision making scheme , 2016, ICRA 2016.

[8]  Kerstin Dautenhahn,et al.  Can Real-Time, Adaptive Human–Robot Motor Coordination Improve Humans’ Overall Perception of a Robot? , 2015, IEEE Transactions on Autonomous Mental Development.

[9]  Luis González Abril,et al.  Customising a qualitative colour description for adaptability and usability , 2015, Pattern Recognit. Lett..

[10]  Bruce Christianson,et al.  A different approach of using Personas in human-robot interaction: Integrating Personas as computational models to modify robot companions' behaviour , 2013, 2013 IEEE RO-MAN.

[11]  Christian Saul,et al.  Generic user Modeling for Adaptive Assessment Systems , 2012, CSEDU.

[12]  Karim Sehaba,et al.  Towards adaptive robots based on interaction traces: A user study , 2013, 2013 16th International Conference on Advanced Robotics (ICAR).

[13]  Silvia Rossi,et al.  User profiling and behavioral adaptation for HRI: A survey , 2017, Pattern Recognit. Lett..

[14]  Cynthia Breazeal,et al.  Bayesian Active Learning-Based Robot Tutor for Children's Word-Reading Skills , 2015, AAAI.

[15]  Paolo Traverso,et al.  Automated Planning and Acting , 2016 .

[16]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[17]  Allen Y. Yang,et al.  Improving human-in-the-loop decision making in multi-mode driver assistance systems using hidden mode stochastic hybrid systems , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[18]  Illah R. Nourbakhsh,et al.  The Impact of Representing Time and Intention , 2013 .

[19]  Frank Steiner,et al.  Embedded Toolkits for User Co-Design: A Technology Acceptance Study of Product Adaptability in the Usage Stage , 2010, 2010 43rd Hawaii International Conference on System Sciences.

[20]  Yiannis Demiris,et al.  User modelling for personalised dressing assistance by humanoid robots , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[21]  Adriana Tapus,et al.  User—robot personality matching and assistive robot behavior adaptation for post-stroke rehabilitation therapy , 2008, Intell. Serv. Robotics.

[22]  John Riedl,et al.  Recommender systems: from algorithms to user experience , 2012, User Modeling and User-Adapted Interaction.

[23]  Salvatore Livatino CVonline : the Evolving, Distributed, Non-Proprietary, On-Line Compendium of Computer Vision , 2003 .

[24]  Anthony F. Norcio,et al.  Adaptive human-computer interfaces: a literature survey and perspective , 1989, IEEE Trans. Syst. Man Cybern..

[25]  Jorge Dias,et al.  Probabilistic Approaches to Robotic Perception , 2014, Springer Tracts in Advanced Robotics.

[26]  Nikolaos Mavridis,et al.  A review of verbal and non-verbal human-robot interactive communication , 2014, Robotics Auton. Syst..

[27]  Adriana Tapus,et al.  A model for synthesizing a combined verbal and nonverbal behavior based on personality traits in human-robot interaction , 2013, 2013 8th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[28]  Horst-Michael Groß,et al.  Online adaptation of dialog strategies based on probabilistic planning , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[29]  Yiannis Demiris,et al.  Towards a synchronised Grammars framework for adaptive musical human-robot collaboration , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[30]  Jaime Valls Miró,et al.  A POMDP framework for modelling human interaction with assistive robots , 2011, 2011 IEEE International Conference on Robotics and Automation.

[31]  Ivo Pereira,et al.  Using personas for supporting user modeling on scheduling systems , 2014, 2014 14th International Conference on Hybrid Intelligent Systems.

[32]  Michael F. McTear,et al.  User modelling for adaptive computer systems: a survey of recent developments , 1993, Artificial Intelligence Review.

[33]  Ali Sekmen,et al.  Assessment of adaptive human-robot interactions , 2013, Knowl. Based Syst..

[34]  Takamitsu Matsubara,et al.  Sequential intention estimation of a mobility aid user for intelligent navigational assistance , 2015, 2015 24th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[35]  Wolfram Burgard,et al.  Robot, organize my shelves! Tidying up objects by predicting user preferences , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[36]  Keng Peng Tee,et al.  Adaptive optimal control for coordination in physical human-robot interaction , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[37]  Abir-Beatrice Karami,et al.  A Decision Model of Adaptive Interaction Selection for a Robot Companion , 2011, ECMR.

[38]  Andrea Lockerd Thomaz,et al.  Real-time changes to social dynamics in human-robot turn-taking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[39]  Karim Sehaba,et al.  Learn to adapt based on users' feedback , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[40]  José-Fernán Martínez-Ortega,et al.  MoKey - A motion based keyboard interpreter , 2015, 2015 International Symposium on Consumer Electronics (ISCE).

[41]  Michael Beetz,et al.  Robot recommender system using affection-based episode ontology for personalization , 2013, 2013 IEEE RO-MAN.

[42]  Illah R. Nourbakhsh,et al.  Planning for Human–Robot Interaction in Socially Situated Tasks , 2013, Int. J. Soc. Robotics.

[43]  Bilge Mutlu,et al.  Anticipatory robot control for efficient human-robot collaboration , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[44]  Alessandro Vinciarelli,et al.  More Personality in Personality Computing , 2014, IEEE Transactions on Affective Computing.

[45]  Maja J. Matarić,et al.  Toward Robot Adaptation of Human Speech and Gesture Parameters in a Unified Framework of Proxemics and Multimodal Communication , 2015 .

[46]  Alexis Tsoukiàs,et al.  Multicriteria User Modeling in Recommender Systems , 2011, IEEE Intelligent Systems.

[47]  Yiannis Demiris,et al.  Adaptive human-robot interaction in sensorimotor task instruction: From human to robot dance tutors , 2014, Robotics Auton. Syst..

[48]  Petros Maragos,et al.  Intelligent Assistive Robotic Systems for the elderly: Two real-life use cases , 2017, PETRA.

[49]  Manuela M. Veloso,et al.  Adaptive Interaction of Persistent Robots to User Temporal Preferences , 2015, ICSR.

[50]  Yen-Lin Chen,et al.  Human-robot interactive assistance of a robotic walking support system in a home environment , 2013, 2013 IEEE International Symposium on Consumer Electronics (ISCE).

[51]  Takanori Shibata,et al.  Robot therapy in a care house - its sociopsychological and physiological effects on the residents , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[52]  Daniel Cremers,et al.  SPENCER: A Socially Aware Service Robot for Passenger Guidance and Help in Busy Airports , 2015, FSR.

[53]  Karim Sehaba,et al.  Adaptive and Personalised Robots - Learning from Users' Feedback , 2013, 2013 IEEE 25th International Conference on Tools with Artificial Intelligence.

[54]  Karim Sehaba,et al.  Adaptive artificial companions learning from users’ feedback , 2016, Adapt. Behav..

[55]  Burr Settles,et al.  Active Learning , 2012, Synthesis Lectures on Artificial Intelligence and Machine Learning.

[56]  Jacqueline Kory Westlunda,et al.  Learning A Second Language with a Socially Assistive Robot , 2015 .

[57]  Tony Belpaeme,et al.  SPARC: Supervised Progressively Autonomous Robot Competencies , 2015, ICSR.

[58]  Hyun-Jun Kim,et al.  Eating activity recognition for health and wellness: A case study on Asian eating style , 2013, 2013 IEEE International Conference on Consumer Electronics (ICCE).

[59]  Nigel Cross Computers and people: Ann Majchrzak, Tien-Chien Chang, Woodrow Barfield, Ray Eberts and Gavriel Salvendy, Human Aspects of Computer-Aided Design, Taylor and Francis, Philadelphia and London, 1986. 278 pp., £25.00 , 1987 .

[60]  Siddhartha S. Srinivasa,et al.  Formalizing human-robot mutual adaptation: A bounded memory model , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[61]  Rachid Alami,et al.  An Adaptive and Proactive Human-Aware Robot Guide , 2015, ICSR.

[62]  Arvid Kappas,et al.  I know how that feels — An empathic robot tutor , 2015, eChallenges e-2015 Conference.

[63]  Alessandro Vinciarelli,et al.  A Survey of Personality Computing , 2014, IEEE Transactions on Affective Computing.

[64]  Gonçalo S. Martins,et al.  The GrowMeUp Project and the Applicability of Action Recognition Techniques , 2015 .

[65]  Takayuki Kanda,et al.  > Replace This Line with Your Paper Identification Number (double-click Here to Edit) < 2 , 2022 .

[66]  Lynne E. Parker,et al.  Simplex-Based 3D Spatio-temporal Feature Description for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[67]  Ben J. A. Kröse,et al.  Accompany: Acceptable robotiCs COMPanions for AgeiNG Years — Multidimensional aspects of human-system interactions , 2013, 2013 6th International Conference on Human System Interactions (HSI).

[68]  Cynthia Breazeal,et al.  Affective Personalization of a Social Robot Tutor for Children's Second Language Skills , 2016, AAAI.

[69]  K. Scherer,et al.  Personality and emotion , 2009 .

[70]  Mark A. Neerincx,et al.  Personalising game difficulty to keep children motivated to play with a social robot: A Bayesian approach , 2017, Cognitive Systems Research.

[71]  Heather Pon-Barry,et al.  Effects of voice-adaptation and social dialogue on perceptions of a robotic learning companion , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[72]  Ana Paiva,et al.  Learning by appraising: an emotion-based approach to intrinsic reward design , 2014, Adapt. Behav..

[73]  Gonçalo S. Martins,et al.  A Context-Aware Adaptability Model for Service Robots , 2016 .

[74]  Barbara De Clercq,et al.  Age-neutrality of the NEO-PI-R: Potential Differential Item Functioning in Older Versus Younger Adults , 2012 .

[75]  Jorge Dias,et al.  Trajectory-based human action segmentation , 2015, Pattern Recognit..

[76]  Dong-Soo Kwon,et al.  Experience based domestic environment and user adaptive cleaning algorithm of a robot cleaner , 2014, 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI).

[77]  de M.M.A. Graaf Living with robots: investigating the user acceptance of social robots in domestic environments , 2015 .

[78]  Manuela M. Veloso,et al.  Personalized Assistance for Dressing Users , 2015, ICSR.

[79]  Rachid Alami,et al.  An implemented theory of mind to improve human-robot shared plans execution , 2016, 2016 11th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[80]  Alessandro Saffiotti,et al.  Making Robots Proactive through Equilibrium Maintenance , 2016, IJCAI.