PHAROS—PHysical Assistant RObot System

The great demographic change leading to an ageing society demands technological solutions to satisfy the increasing varied elderly needs. This paper presents PHAROS, an interactive robot system that recommends and monitors physical exercises designed for the elderly. The aim of PHAROS is to be a friendly elderly companion that periodically suggests personalised physical activities, promoting healthy living and active ageing. Here, it is presented the PHAROS architecture, components and experimental results. The architecture has three main strands: a Pepper robot, that interacts with the users and records their exercises performance; the Human Exercise Recognition, that uses the Pepper recorded information to classify the exercise performed using Deep Leaning methods; and the Recommender, a smart-decision maker that schedules periodically personalised physical exercises in the users’ agenda. The experimental results show a high accuracy in terms of detecting and classifying the physical exercises (97.35%) done by 7 persons. Furthermore, we have implemented a novel procedure of rating exercises on the recommendation algorithm. It closely follows the users’ health status (poor performance may reveal health problems) and adapts the suggestions to it. The history may be used to access the physical condition of the user, revealing underlying problems that may be impossible to see otherwise.

[1]  Gustaf Hendeby,et al.  A personalized exercise trainer for elderly , 2011, 2011 5th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[2]  Vicente Julián,et al.  Advances and trends for the development of ambient‐assisted living platforms , 2017, Expert Syst. J. Knowl. Eng..

[3]  Rama Chellappa,et al.  Human Action Recognition by Representing 3D Skeletons as Points in a Lie Group , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Yosuke Matsusaka,et al.  Health exercise demonstration robot TAIZO and effects of using voice command in robot-human collaborative demonstration , 2009, RO-MAN 2009 - The 18th IEEE International Symposium on Robot and Human Interactive Communication.

[5]  Angel P. del Pobil,et al.  Find It - An Assistant Home Agent , 2013, PAAMS.

[6]  Varun Ramakrishna,et al.  Convolutional Pose Machines , 2016, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[7]  Fabio Paternò,et al.  End-user personalization of context-dependent applications in AAL scenarios , 2016, MobileHCI Adjunct.

[8]  Brian Scassellati,et al.  The Benefits of Interactions with Physically Present Robots over Video-Displayed Agents , 2011, Int. J. Soc. Robotics.

[9]  Albert Ali Salah,et al.  An autonomous robotic exercise tutor for elderly people , 2017, Auton. Robots.

[10]  Pawe Pawiak,et al.  Novel methodology of cardiac health recognition based on ECG signals and evolutionary-neural system , 2018 .

[11]  T. Lawson,et al.  Spark , 2011 .

[12]  Yaser Sheikh,et al.  OpenPose: Realtime Multi-Person 2D Pose Estimation Using Part Affinity Fields , 2018, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Michal Niedzwiecki,et al.  Hand Body Language Gesture Recognition Based on Signals From Specialized Glove and Machine Learning Algorithms , 2016, IEEE Transactions on Industrial Informatics.

[14]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[15]  Pawel Plawiak,et al.  Novel methodology of cardiac health recognition based on ECG signals and evolutionary-neural system , 2018, Expert Syst. Appl..

[16]  Mohammed Hassan Ahmed,et al.  Smart Home Activities: A Literature Review , 2014 .

[17]  L. Bherer,et al.  A Review of the Effects of Physical Activity and Exercise on Cognitive and Brain Functions in Older Adults , 2013, Journal of aging research.

[18]  Yunhwan Lee,et al.  Changes in physical activity and cognitive decline in older adults living in the community , 2015, AGE.

[19]  M. Meyyappan,et al.  U-Health Smart Home , 2011, IEEE Nanotechnology Magazine.

[20]  M. Harrison A Global Perspective , 2015, Bulletin of the history of medicine.

[21]  Jimmy Ba,et al.  Adam: A Method for Stochastic Optimization , 2014, ICLR.

[22]  Paulo Novais,et al.  Promoting independent living and recreation in life through ambient assisted living technology , 2015 .

[23]  Lynne E. Parker,et al.  4-dimensional local spatio-temporal features for human activity recognition , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[24]  R. Califf,et al.  Surrogate and Physician Understanding of Patients' Preferences for Living Permanently in a Nursing Home , 1997, Journal of the American Geriatrics Society.

[25]  Pawel Plawiak,et al.  Novel genetic ensembles of classifiers applied to myocardium dysfunction recognition based on ECG signals , 2017, Swarm Evol. Comput..

[26]  Quoc V. Le,et al.  Learning hierarchical invariant spatio-temporal features for action recognition with independent subspace analysis , 2011, CVPR 2011.

[27]  Nelson Pacheco da Rocha,et al.  ICF Inspired Personas to Improve Development for Usability and Accessibility in Ambient Assisted Living , 2013, DSAI.

[28]  Yoshua Bengio,et al.  Learning Phrase Representations using RNN Encoder–Decoder for Statistical Machine Translation , 2014, EMNLP.

[29]  Yu Zhang,et al.  Simultaneous Feature and Body-Part Learning for real-time robot awareness of human behaviors , 2017, 2017 IEEE International Conference on Robotics and Automation (ICRA).

[30]  Himalaya Patel,et al.  Toward Monitoring and Increasing Exercise Adherence in Older Adults by Robotic Intervention: A Proof of Concept Study , 2011, J. Robotics.