Identification of Cognitive Navigational Commands for Mobile Robots Based on Hand Gestures and Vocal Commands

Assistive robots are developed to uplift living standards of human beings. An assistive robot needs to be friendly, reliable, and understandable in order to be a human like companion. A robot should be able to navigate in an environment according to users' commands. Users' commands can be vocal or gestures. Combining users' command types to identify the navigation information will enhance the user-robot interaction and makes navigation more effective and purposeful. Moreover, understanding the relationship between the navigation commands makes the robot a more human friendly companion. A robot should be capable of interpreting spatial information in uncertain terms. Moreover it should be able to improve the knowledge through communicating with the user, itself. The Cognitive Map Creator (CMC) has been introduced to create a cognitive map of direct navigational commands to enhance the interaction between the human and the robot which will help to make a robot more human-friendly. The Conversation Management Module (CMM), Spatial Data Interpreter (SDI) and Navigational Command Identifier (NCI) have been introduced in order to create a cognitive map of navigational commands. The capabilities of the robot have been demonstrated and evaluated from experimental results.

[1]  Chandima Dedduwa Pathiranage,et al.  Grounding Object Attributes Through Interactive Discussion for Building Cognitive Maps in Service Robots , 2018, 2018 IEEE International Conference on Systems, Man, and Cybernetics (SMC).

[2]  Mariangela Manti,et al.  Soft assistive robot for personal care of elderly people , 2016, 2016 6th IEEE International Conference on Biomedical Robotics and Biomechatronics (BioRob).

[3]  Marjorie Skubic,et al.  Spatial language for human-robot dialogs , 2004, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[4]  D. P. Chandima,et al.  Enhancing Conceptual Spatial Map by Amalgamating Spatial and Virtual Cognitive Maps for Domestic Service Robots , 2018, 2018 2nd International Conference On Electrical Engineering (EECon).

[5]  M. A. Viraj J. Muthugala,et al.  A Review of Service Robots Coping With Uncertain Information in Natural Language Instructions , 2018, IEEE Access.

[6]  Hassan Noura,et al.  A gesture based kinect for quadrotor control , 2015, 2015 International Conference on Information and Communication Technology Research (ICTRC).

[7]  M. A. Viraj J. Muthugala,et al.  Enhancing human-robot interaction by interpreting uncertain information in navigational commands based on experience and environment , 2016, 2016 IEEE International Conference on Robotics and Automation (ICRA).

[8]  M. A. Viraj J. Muthugala,et al.  MIRob: An intelligent service robot that learns from interactive discussions while handling uncertain information in user instructions , 2016 .

[9]  Stefan Wermter,et al.  Hey robot, why don't you talk to me? , 2017, 2017 26th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[10]  Tomoko Kohori,et al.  Development and Evaluation of an Interactive Therapy Robot , 2017, ACE.

[11]  Kristian Ehlers,et al.  A human-robot interaction interface for mobile and stationary robots based on real-time 3D human body and hand-finger pose estimation , 2016, 2016 IEEE 21st International Conference on Emerging Technologies and Factory Automation (ETFA).

[12]  Jason M. O'Kane,et al.  A low-cost socially assistive robot and robot-assisted intervention for children with autism spectrum disorder: field trials and lessons learned , 2016, Autonomous Robots.

[13]  Wolfram Burgard,et al.  Conceptual spatial representations for indoor mobile robots , 2008, Robotics Auton. Syst..

[14]  A. G. Buddhika P. Jayasekara,et al.  MIRob: An intelligent service robot that learns from interactive discussions while handling uncertain information in user instructions , 2016, 2016 Moratuwa Engineering Research Conference (MERCon).

[15]  Saso Koceski,et al.  Evaluation of an Assistive Telepresence Robot for Elderly Healthcare , 2016, Journal of Medical Systems.

[16]  Mohammad H. Mahoor,et al.  A pilot study on using an intelligent life-like robot as a companion for elderly individuals with dementia and depression , 2017, 2017 IEEE-RAS 17th International Conference on Humanoid Robotics (Humanoids).

[17]  A.G.B.P. Jayasekara,et al.  Development of an interactive service robot arm for object manipulation , 2017, 2017 IEEE International Conference on Industrial and Information Systems (ICIIS).

[18]  Guy Hoffman,et al.  Design and Evaluation of a Peripheral Robotic Conversation Companion , 2015, 2015 10th ACM/IEEE International Conference on Human-Robot Interaction (HRI).

[19]  Ya-Huei Wu,et al.  The Attitudes and Perceptions of Older Adults With Mild Cognitive Impairment Toward an Assistive Robot , 2016, Journal of applied gerontology : the official journal of the Southern Gerontological Society.

[20]  Chandima Dedduwa Pathiranage,et al.  Cognitive Spatial Representative Map for Interactive Conversational Model of Service Robot , 2018, 2018 27th IEEE International Symposium on Robot and Human Interactive Communication (RO-MAN).

[21]  Jill Fain Lehman,et al.  Persistent Memory in Repeated Child-Robot Conversations , 2017, IDC.