Fuzzy context-specific intention inference for robotic caregiving

To provide timely and appropriate assistance, robots must have the capability of proactively understanding a user’s personal needs, the so-called human intention inference. In human–human interaction, humans have a natural and implicit way to infer others’ intentions by selecting correlated context features and interpreting these features based on their life experience. However, robots do not have this capability and it is not realistic to build an explicit formula to associate human intentions with context. In this article, a novel fuzzy context-specific intention inference method is developed for human-like implicit human intention inference. With a fuzzy manner, context features are converted into discrete context statuses, which are similar to human subjective feelings. An intention-centered common sense database is developed consisting of correlated fuzzy context statuses, object affordances, and their relationship with human intentions. With this database, a Fuzzy Naïve Bayesian Network algorithm is adopted for implicit intention inference. Home scenario results validated the fuzzy context-specific intention inference methods reliability and lab scenario results validated the fuzzy context-specific intention inference methods effectiveness and robustness. This work is expected to develop intuitive and effective human–robot interaction, consequently enhancing the adoption of assistive technologies and improving the independence of the disabled and elderly in activities of daily living.

[1]  T. Yamaguchi,et al.  Suspicious Behavior Detection based on Case-Based Reasoning using Face Direction , 2006, 2006 SICE-ICASE International Joint Conference.

[2]  Christian Laugier,et al.  Exploiting map information for driver intention estimation at road intersections , 2011, 2011 IEEE Intelligent Vehicles Symposium (IV).

[3]  Tapio Seppänen,et al.  Adapting applications in handheld devices using fuzzy context information , 2003, Interact. Comput..

[4]  Elpiniki I. Papageorgiou,et al.  A fuzzy cognitive map based tool for prediction of infectious diseases , 2009, 2009 IEEE International Conference on Fuzzy Systems.

[5]  Rachid Alami,et al.  Human-aware robot navigation: A survey , 2013, Robotics Auton. Syst..

[6]  Antonio Frisoli,et al.  A new Kinect-based guidance mode for upper limb robot-aided neurorehabilitation , 2012, 2012 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[7]  Roger C. Schank,et al.  Scripts, plans, goals and understanding: an inquiry into human knowledge structures , 1978 .

[8]  Xinping Yan,et al.  A Recognition Model for Acceleration Intention of Automobile Drivers based on Fuzzy Clustering , 2011 .

[9]  Sebastian Thrun,et al.  A robotic walker that provides guidance , 2003, 2003 IEEE International Conference on Robotics and Automation (Cat. No.03CH37422).

[10]  Joelle Pineau,et al.  Towards robotic assistants in nursing homes: Challenges and results , 2003, Robotics Auton. Syst..

[11]  Luís Moniz Pereira,et al.  Elder Care via Intention Recognition and Evolution Prospection , 2009, INAP.

[12]  Joelle Pineau,et al.  Experiences with a mobile robotic guide for the elderly , 2002, AAAI/IAAI.

[13]  Rui Liu,et al.  Use context to understand user's implicit intentions in Activities of Daily Living , 2014, 2014 IEEE International Conference on Mechatronics and Automation.

[14]  Peter Ford Dominey,et al.  The basis of shared intentions in human and robot cognition , 2011 .

[15]  Karim A. Tahboub,et al.  Journal of Intelligent and Robotic Systems (2005) DOI: 10.1007/s10846-005-9018-0 Intelligent Human–Machine Interaction Based on Dynamic Bayesian Networks Probabilistic Intention Recognition , 2004 .

[16]  Sung-Bae Cho,et al.  A modular design of Bayesian networks using expert knowledge: Context-aware home service robot , 2012, Expert Syst. Appl..

[17]  Christopher C. Cummins,et al.  A model of intentional communication: AIRBUS (Asymmetric Intention Recognition with Bayesian Updating of Signals) , 2012 .

[18]  Zhiwen Yu,et al.  A context-aware reminder system for elders based on fuzzy linguistic approach , 2012, Expert Syst. Appl..

[19]  Kristoffer Lidström,et al.  Model-based Estimation of Driver Intentions Using Particle Filtering , 2008, 2008 11th International IEEE Conference on Intelligent Transportation Systems.

[20]  Robin R. Murphy,et al.  Human-Robot Interaction , 2012 .

[21]  Karim A. Tahboub Natural and manmade shared-control systems: an overview , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[22]  Wenji Mao,et al.  A Utility-Based Approach to Intention Recognition , 2004, AAMAS 2004.

[23]  Phil Berger,et al.  The Information Content of Forward-Looking Statements in Corporate Filings—A Na¨ive Bayesian Machine Learning Approach , 2010 .

[24]  M Tenorth,et al.  Web-Enabled Robots , 2011, IEEE Robotics & Automation Magazine.

[25]  Martha E. Pollack,et al.  Autominder: an intelligent cognitive orthotic system for people with memory impairment , 2003, Robotics Auton. Syst..

[26]  Mikio Nakano,et al.  Understanding Unsegmented User Utterances in Real-Time Spoken Dialogue Systems , 1999, ACL.

[27]  T. Yamaguchi,et al.  Intention recognition using conceptual fuzzy sets , 1993, [Proceedings 1993] Second IEEE International Conference on Fuzzy Systems.

[28]  D. Fox,et al.  Towards Personal Service Robots for the Elderly , 1999 .

[29]  J. Gregory Trafton,et al.  Enabling effective human-robot interaction using perspective-taking in robots , 2005, IEEE Transactions on Systems, Man, and Cybernetics - Part A: Systems and Humans.

[30]  Y. Sakaguchi,et al.  Prediction of Driving Behavior through Probabilistic Inference , 2003 .

[31]  Gregory D. Abowd,et al.  Towards a Better Understanding of Context and Context-Awareness , 1999, HUC.

[32]  Ren-Hung Hwang,et al.  UbiPaPaGo: Context-aware path planning , 2011, Expert Syst. Appl..

[33]  Dimitrios K. Iakovidis,et al.  Intuitionistic Fuzzy Cognitive Maps for Medical Decision Making , 2011, IEEE Transactions on Information Technology in Biomedicine.

[34]  Christoph Schlieder,et al.  Exploring Context-Sensitivity in Spatial Intention Recognition , 2007, BMI.

[35]  Fumio Harashima,et al.  Natural Interface Using Pointing Behavior for Human–Robot Gestural Interaction , 2007, IEEE Transactions on Industrial Electronics.

[36]  Giovanni Pezzulo,et al.  What should I do next? Using shared representations to solve interaction problems , 2011, Experimental Brain Research.

[37]  Piero Cosi,et al.  Long-term human-robot interaction with young users , 2011, HRI 2011.

[38]  Federico Viani,et al.  Wireless Architectures for Heterogeneous Sensing in Smart Home Applications: Concepts and Real Implementation , 2013, Proceedings of the IEEE.

[39]  Xiaoli Zhang,et al.  Context-specific intention awareness through web query in robotic caregiving , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[40]  Hyun Kim,et al.  Developing a Context-Aware System for Providing Intelligent Robot Services , 2006, EuroSSC.

[41]  Giovanni Pezzulo,et al.  Proceedings of the Twenty-Second International Joint Conference on Artificial Intelligence Motor Simulation via Coupled Internal Models Using Sequential Monte Carlo , 2022 .

[42]  Feng Li The Information Content of Forward-Looking Statements in Corporate Filings—A Naïve Bayesian Machine Learning Approach , 2010 .

[43]  Martha E. Pollack,et al.  Intelligent Technology for an Aging Population: The Use of AI to Assist Elders with Cognitive Impairment , 2005, AI Mag..

[44]  Hanneke E. M. den Ouden,et al.  Thinking about intentions , 2005, NeuroImage.

[45]  Uwe D. Hanebeck,et al.  Tractable probabilistic models for intention recognition based on expert knowledge , 2007, 2007 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[46]  Uwe D. Hanebeck,et al.  Situation-Specific Intention Recognition for Human-Robot Cooperation , 2010, KI.

[47]  Peter Kiefer,et al.  A Framework for Mobile Intention Recognition in Spatially Structured Environments , 2008, BMI.

[48]  M. Brass,et al.  Investigating Action Understanding: Inferential Processes versus Action Simulation , 2007, Current Biology.

[49]  Alessandro Saffiotti,et al.  PEIS ecologies: ambient intelligence meets autonomous robotics , 2005, sOc-EUSAI '05.

[50]  Raymond J. Cole,et al.  Building environmental assessment methods: redefining intentions and roles , 2005 .

[51]  Xiaoli Zhang,et al.  Understanding Human Behaviors with an Object Functional Role Perspective for Robotics , 2016, IEEE Transactions on Cognitive and Developmental Systems.

[52]  L. Millard,et al.  Nurse-patient interaction and decision-making in care: patient involvement in community nursing. , 2006, Journal of advanced nursing.

[53]  Jie Yang,et al.  Sensor Fusion Using Dempster-Shafer Theory , 2002 .

[54]  Dominik Henrich,et al.  Human-robot collaboration by intention recognition using probabilistic state machines , 2010, 19th International Workshop on Robotics in Alpe-Adria-Danube Region (RAAD 2010).

[55]  Kevin P. Murphy,et al.  Machine learning - a probabilistic perspective , 2012, Adaptive computation and machine learning series.