Integration and evaluation of a gaming situation for long-term human-robot interaction: playing a game of pairs with Flobi using contextual knowledge

This doctoral thesis proposes a system for long-term Interaction between a robot and a human using a gaming context. A robot plays a game of pairs autonomously with a human. The system was developed to evaluate how to implement social assistive robots during space missions that occur under isolation conditions. The first part of the thesis presents the system as designed and implemented. Described are the different components used to realize autonomous interaction. The study itself was conducted in cooperation with the German Aerospace Center. Throughout the study, the proposed system performed robustly, and without major system failures. The participants interacted with the system continuously, and gave it average ratings for acceptability. No significant extraneous effects, such as those related to novelty were found. Nevertheless, problems with perception and classification led to negative ratings for the system’s competence. The second part of the thesis was motivated by findings from the isolation study. Integrated is a context knowledge system to increase interest in the interactions during long-term use. This made it possible to collect data on past interactions for use with further interactions. The results of a study showed that greater commitment to gaming interaction could be promoted by using context knowledge. In addition, implemented is a remotely controlled version of the system to evaluate, whether a robot without visual or speech recognition problems who played perfectly could influence the way the system was perceived. Results showed that ratings on participant enjoyment while playing with the system decreased when the playing system was too perfect. Additionally, a robot that played too perfectly appeared to promote unfair game-play behaviors in the human, likely as an attempt to cope with disadvantages such as lower memory capacity.

[1]  Ana Paiva,et al.  Empathic Robots for Long-term Interaction , 2014, Int. J. Soc. Robotics.

[2]  Ruth Aylett,et al.  An initial memory model for virtual and robot companions supporting migration and long-term interaction , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[3]  Jodi Forlizzi,et al.  How robotic products become social products: An ethnographic study of cleaning in the home , 2007, 2007 2nd ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[4]  Nadia Magnenat-Thalmann,et al.  Building long-term relationships with virtual and robotic characters: the role of remembering , 2011, The Visual Computer.

[5]  Kerstin Dautenhahn,et al.  Episodic memory visualization in robot companions providing a memory prosthesis for elderly users , 2013 .

[6]  Takayuki Kanda,et al.  Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial , 2004, Hum. Comput. Interact..

[7]  Christian Bauckhage,et al.  An XML based framework for cognitive vision architectures , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[8]  E. Tulving [Episodic memory: from mind to brain]. , 2004, Revue neurologique.

[9]  Britta Wrede,et al.  Pamini: A framework for assembling mixed-initiative human-robot interaction from generic interaction patterns , 2010, SIGDIAL Conference.

[10]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  Kerstin Dautenhahn,et al.  An Interactive Game with a Robot: Peoples' Perceptions of Robot Faces and a Gesture-Based User Interface , 2013, ACHI 2013.

[12]  Ingo Lütkebohle,et al.  Social Robots for Long-Term Space Missions , 2012 .

[13]  Bernhard Nebel,et al.  The hybrid agent MARCO: a multimodal autonomous robotic chess opponent , 2014, HAI.

[14]  Stephanie Rosenthal,et al.  Designing robots for long-term social interaction , 2005, 2005 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[15]  Justin W. Hart,et al.  No fair!!: an interaction with a cheating robot , 2010, HRI 2010.

[16]  M. Bruck,et al.  Suggestibility of the child witness: a historical review and synthesis. , 1993, Psychological bulletin.

[17]  Joris B. Janssen,et al.  Motivating Children to Learn Arithmetic with an Adaptive Robot Game , 2011, ICSR.

[18]  Cyril Brom,et al.  Episodic Memory for Human-like Agents and Human-like Agents for Episodic Memory , 2010, AAAI Fall Symposium: Biologically Inspired Cognitive Architectures.

[19]  Kerstin Dautenhahn,et al.  Living with Robots: Investigating the Habituation Effect in Participants' Preferences During a Longitudinal Human-Robot Interaction Study , 2007, RO-MAN 2007 - The 16th IEEE International Symposium on Robot and Human Interactive Communication.

[20]  Takanori Shibata,et al.  Robot Therapy in a Care House - Results of Case Studies - , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[21]  Ruth Aylett,et al.  A Socially-Aware Memory for Companion Agents , 2009, IVA.

[22]  Goldie Nejat,et al.  Playing a memory game with a socially assistive robot: A case study at a long-term care facility , 2012, 2012 IEEE RO-MAN: The 21st IEEE International Symposium on Robot and Human Interactive Communication.

[23]  Stefan Kopp,et al.  To Err is Human(-like): Effects of Robot Gesture on Perceived Anthropomorphism and Likability , 2013, International Journal of Social Robotics.

[24]  D. Snydacker,et al.  Adler's Physiology of the Eye. Clinical Application , 1981 .

[25]  Kenji Suzuki,et al.  Analysis of Bluffing Behavior in Human-Humanoid Poker Game , 2011, ICSR.

[26]  E. Tulving,et al.  Episodic and semantic memory , 1972 .

[27]  Roland Bup Alleviating social isolation and loneliness among olderpeople in Britain: what are the impacts, limitations, andchallenges to the current interventions targeting socialisolation and loneliness? , 2015 .

[28]  T. Kanda,et al.  Psychology in human-robot communication: an attempt through investigation of negative attitudes and anxiety toward robots , 2004, RO-MAN 2004. 13th IEEE International Workshop on Robot and Human Interactive Communication (IEEE Catalog No.04TH8759).

[29]  Will Dodd,et al.  The role of episodic memory and emotion in a cognitive robot , 2005, ROMAN 2005. IEEE International Workshop on Robot and Human Interactive Communication, 2005..

[30]  Franz Kummert,et al.  Dynamic dialog system for human robot collaboration: playing a game of pairs , 2014, HAI.

[31]  Mohammed Bennamoun,et al.  Linear Regression for Face Recognition , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[32]  Lisa F. Berkman,et al.  Social Networks, Host Resistance, and Mortality: A Nine-Year Follow-up Study of Alameda County Residents. , 2017, American journal of epidemiology.

[33]  K. Dautenhahn,et al.  Long-term affect sensitive and socially interactive companions , 2008 .

[34]  Ana Paiva,et al.  Social Robots for Long-Term Interaction: A Survey , 2013, International Journal of Social Robotics.

[35]  Nick Kanas,et al.  Space Psychology and Psychiatry , 2003 .

[36]  Brigitte Le Pévédic,et al.  Robot or tablet: Users' behaviors on a memory game , 2014, The 23rd IEEE International Symposium on Robot and Human Interactive Communication.

[37]  Batya Friedman,et al.  Robotic pets in the lives of preschool children , 2004, CHI EA '04.

[38]  Birte Carlmeyer,et al.  Demonstration of Emotion Modeling using Flobi* , 2014, 2014 9th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[39]  Nadia Magnenat-Thalmann,et al.  Towards episodic memory-based long-term affective interaction with a human-like robot , 2010, 19th International Symposium in Robot and Human Interactive Communication.

[40]  Cynthia Breazeal,et al.  Robots at home: Understanding long-term human-robot interaction , 2008, 2008 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[41]  Chih-Wei Chang,et al.  A Robot as a Teaching Assistant in an English Class , 2006 .

[42]  Ingo Lütkebohle,et al.  The bielefeld anthropomorphic robot head “Flobi” , 2010, 2010 IEEE International Conference on Robotics and Automation.

[43]  Ingo Lütkebohle,et al.  Coordination and composition patterns in the "Curious Robot" scenario , 2011 .