A Deep Learning Based Autonomous Mobile Robotic Assistive Care Giver

Assistive robotic technology is increasingly employed in many industries including health care. One of the most important features of this assistive technology is its autonomous verbal communication skill. We propose a new theory for autonomous agent based on the five human senses. Then we proceed to address one of the five senses, the speech. Our approach to address and develop an autonomous verbal communication is to apply deep learning to learn about different topics in healthcare. We developed a novel approach where we created a set of question-answer dataset from articles and interviews with physician specialist from U.S. National Public Radio (NPR). We trained a deep learning model which is able to listen to conversations between a patient and a physician to answer to the questions when the physician is not able to answer or it might not answer the question completely. We discuss the corpus on Health Science which shows what NPR can teach to machine. We share the usage of the Corpus to train a deep learning model to be used by pepper which is a humanoid robot that can be implemented in helping provide elderly care in individuals diagnosed with early stages of dementia.

[1]  Andre Esteva,et al.  A guide to deep learning in healthcare , 2019, Nature Medicine.

[2]  ジョーダン,チャールズ・エス,et al.  Telepresence robot with camera boom , 2009 .

[3]  T. Shibata,et al.  Social and physiological influences of robot therapy in a care house , 2008 .

[4]  Marie Tahon,et al.  Inference of Human Beings’ Emotional States from Speech in Human–Robot Interactions , 2015, Int. J. Soc. Robotics.

[5]  Hiroyuki Iizuka,et al.  How (not) to model autonomous behaviour , 2008, Biosyst..

[6]  Guo Li,et al.  A Master-Slave Separate Parallel Intelligent Mobile Robot Used for Autonomous Pallet Transportation , 2019 .

[7]  Wei Chu,et al.  AliMe Chat: A Sequence to Sequence and Rerank based Chatbot Engine , 2017, ACL.

[8]  Gavin Hackeling,et al.  Mastering Machine Learning With scikit-learn , 2014 .

[9]  Brian Scassellati,et al.  Integrating socially assistive robotics into mental healthcare interventions: applications and recommendations for expanded use. , 2015, Clinical Psychology Review.

[10]  Marcela D. Rodríguez,et al.  Privacy-Aware Autonomous Agents for Pervasive Healthcare , 2006, IEEE Intelligent Systems.

[11]  Guillaume Dubuisson Duplessis,et al.  Towards Metrics of Evaluation of Pepper Robot as a Social Companion for the Elderly , 2018, IWSDS.

[12]  K. Wada,et al.  How Effective Is Robot Therapy?: PARO and People with Dementia , 2011 .

[13]  S C Orphanoudakis,et al.  A framework for the integration of distributed autonomous healthcare information systems. , 1997, Medical informatics = Medecine et informatique.

[14]  Takanori Shibata,et al.  Effects of robot-assisted activity for elderly people and nurses at a day service center , 2004, Proceedings of the IEEE.

[15]  Manuela M. Veloso,et al.  Setting Up Pepper For Autonomous Navigation And Personalized Interaction With Users , 2017, ArXiv.

[16]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL.

[17]  Joanna Bryson,et al.  Cross-paradigm analysis of autonomous agent architecture , 2000, J. Exp. Theor. Artif. Intell..

[18]  Peter Wittenburg,et al.  Improving Native Language Identification with TF-IDF Weighting , 2013, BEA@NAACL-HLT.

[19]  Quoc V. Le,et al.  Sequence to Sequence Learning with Neural Networks , 2014, NIPS.

[20]  Pattie Maes,et al.  Modeling Adaptive Autonomous Agents , 1993, Artificial Life.

[21]  Jeffrey Pennington,et al.  GloVe: Global Vectors for Word Representation , 2014, EMNLP.

[22]  Bruce A. MacDonald,et al.  Acceptance of Healthcare Robots for the Older Population: Review and Future Directions , 2009, Int. J. Soc. Robotics.

[23]  Wilhelm Hasselbring,et al.  The SI challenge in health care , 2000, CACM.

[24]  Jean-Michel Redoute,et al.  An Autonomous Wireless Body Area Network Implementation Towards IoT Connected Healthcare Applications , 2017, IEEE Access.

[25]  M. Matarić,et al.  The use of socially assistive robots in the design of intelligent cognitive therapies for people with dementia , 2009, 2009 IEEE International Conference on Rehabilitation Robotics.

[26]  Holger Schwenk,et al.  Supervised Learning of Universal Sentence Representations from Natural Language Inference Data , 2017, EMNLP.

[27]  Mohamed Elhoseny,et al.  Collaborative task assignment of interconnected, affective robots towards autonomous healthcare assistant , 2019, Future Gener. Comput. Syst..

[28]  Arthur C. Graesser,et al.  Is it an Agent, or Just a Program?: A Taxonomy for Autonomous Agents , 1996, ATAL.

[29]  U. Rajendra Acharya,et al.  Deep learning for healthcare applications based on physiological signals: A review , 2018, Comput. Methods Programs Biomed..

[30]  N. M. Kakoty,et al.  Mobile Robot Navigation in Unknown Dynamic Environment Inspired by Human Pedestrian Behavior , 2018, Advances in Intelligent Systems and Computing.

[31]  Geoffrey E. Hinton,et al.  Rectified Linear Units Improve Restricted Boltzmann Machines , 2010, ICML.

[32]  Saso Koceski,et al.  A Telemedicine Robot System for Assisted and Independent Living , 2019, Sensors.

[33]  E. Mordoch,et al.  Use of social commitment robots in the care of elderly people with dementia: a literature review. , 2013, Maturitas.

[34]  Domenico Presenza,et al.  Key challenges for developing a Socially Assistive Robotic (SAR) solution for the health sector , 2018, 2018 IEEE 23rd International Workshop on Computer Aided Modeling and Design of Communication Links and Networks (CAMAD).

[35]  Xiang Zhang,et al.  Action representations in robotics: A taxonomy and systematic classification , 2018, Int. J. Robotics Res..

[36]  Wayne H. Wolf,et al.  Cyber-physical Systems , 2009, Computer.

[37]  Klaus A. Kuhn,et al.  Semantic Integration in Healthcare Networks , 2005, MIE.

[38]  Steven Bird,et al.  NLTK: The Natural Language Toolkit , 2002, ACL 2006.

[39]  Ren C. Luo,et al.  Dynamic Wireless Indoor Localization Incorporating With an Autonomous Mobile Robot Based on an Adaptive Signal Model Fingerprinting Approach , 2019, IEEE Transactions on Industrial Electronics.

[40]  Klaus A. Kuhn,et al.  Towards a flexible, process-oriented IT architecture for an integrated healthcare network , 2004, SAC '04.

[41]  John Fox,et al.  Artificial intelligence-enabled healthcare delivery , 2018, Journal of the Royal Society of Medicine.