Multimodal Fuzzy Assessment for Robot Behavioral Adaptation in Educational Children-Robot Interaction

Social robots' contributions to education are notorious but, in times, limited by the difficulty in their programming by regular teachers. Our framework named R-CASTLE aims to overcome this problem by providing the teachers with an easy way to program their content and the robot's behavior through a graphical interface. However, the robot's behavior adaptation algorithm maybe still not the best intuitive method for teachers' understanding. Fuzzy systems have the advantage of being modeled in a more human-like way than other methods due to their implementation based on linguistic variables and terms. Thus, fuzzy modeling for robot behavior adaptation in educational children-robot interactions is proposed for this framework. The modeling resulted in an adaptation algorithm that considers a multimodal and autonomous assessment of the students' skills: attention, communication, and learning. Furthermore, preliminary experiments were performed considering videos with the robot in a school environment. The adaptation was set to change the content approach difficulty to produce a suitably challenging behavior according to each students' reactions. Results were compared to a Rule-Based adaptive method. The fuzzy modeling showed similar accuracy to the ruled-based method with a suggestion of a more intuitive interpretation of the process.

[1]  Lakhmi C. Jain,et al.  Introduction to fuzzy systems , 1995, Proceedings Electronic Technology Directions to the Year 2000.

[2]  Omar Mubin,et al.  Understanding Behaviours and Roles for Social and Adaptive Robots In Education: Teacher's Perspective , 2016, HAI.

[3]  Jorge Dias,et al.  User-Adaptive Interaction in Social Robots: A Survey Focusing on Non-physical Interaction , 2018, Int. J. Soc. Robotics.

[4]  Daniel Carnieto Tozadore Robotic - Cognitive Adaptive System for Teaching and Learning (R-CASTLE) , 2020 .

[5]  Roseli Romero,et al.  Effects of Emotion Grouping for Recognition in Human-Robot Interactions , 2018, 2018 7th Brazilian Conference on Intelligent Systems (BRACIS).

[6]  Andrea Lockerd Thomaz,et al.  Real-time changes to social dynamics in human-robot turn-taking , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[7]  Kay A. Persichitte,et al.  Fuzzy cognitive mapping: Applications in education , 2000, Int. J. Intell. Syst..

[8]  Elmira Yadollahi,et al.  Exploring the Role of Perspective Taking in Educational Child-Robot Interaction , 2020, AIED.

[9]  Murillo Rehder Batista,et al.  Tablets and humanoid robots as engaging platforms for teaching languages , 2017, 2017 Latin American Robotics Symposium (LARS) and 2017 Brazilian Symposium on Robotics (SBR).

[10]  Filippo Cavallo,et al.  A Survey of Behavioral Models for Social Robots , 2019, Robotics.

[11]  Roseli Aparecida Francelin Romero,et al.  Towards Adaptation and Personalization in Task Based on Human-Robot Interaction , 2018, 2018 Latin American Robotic Symposium, 2018 Brazilian Symposium on Robotics (SBR) and 2018 Workshop on Robotics in Education (WRE).

[12]  Pedro Ponce,et al.  Fuzzy Logic Type 1 and 2 for Social Robots and Apps for Children with Autism , 2017, 2017 Sixteenth Mexican International Conference on Artificial Intelligence (MICAI).

[13]  Jinil Kim,et al.  Learning achievement evaluation strategy using fuzzy membership function , 2001, 31st Annual Frontiers in Education Conference. Impact on Engineering and Science Education. Conference Proceedings (Cat. No.01CH37193).

[14]  Ru-Jen Chao,et al.  Evaluation of the criteria and effectiveness of distance e-learning with consistent fuzzy preference relations , 2009, Expert Syst. Appl..

[15]  Adam H. M. Pinto,et al.  Project R-CASTLE: Robotic-Cognitive Adaptive System for Teaching and Learning , 2019, IEEE Transactions on Cognitive and Developmental Systems.

[16]  Brian Scassellati,et al.  Robots for Learning - R4L: Adaptive Learning , 2019, 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[17]  Kerstin Dautenhahn,et al.  Can Real-Time, Adaptive Human–Robot Motor Coordination Improve Humans’ Overall Perception of a Robot? , 2015, IEEE Transactions on Autonomous Mental Development.

[18]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  Yen-Lin Chen,et al.  Human-robot interactive assistance of a robotic walking support system in a home environment , 2013, 2013 IEEE International Symposium on Consumer Electronics (ISCE).

[20]  Fakhreddine Karray,et al.  Intelligent control: Fuzzy logic applications , 1997 .

[21]  Sotiris Makris,et al.  Human–robot interaction review and challenges on task planning and programming , 2016, Int. J. Comput. Integr. Manuf..