In-House Deep Environmental Sentience for Smart Homecare Solutions toward Ageing Society

With an increasing amount of elderly people needing home care around the clock, care workers are not able to keep up with the demand of providing maximum support to those who require it. As medical costs of home care increase the quality is care suffering as a result of staff shortages, a solution is desperately needed to make the valuable care time of these workers more efficient. This paper proposes a system that is able to make use of the deep learning resources currently available to produce a base system that could provide a solution to many of the problems that care homes and staff face today. Transfer learning was conducted on a deep convolutional neural network to recognize common household objects was proposed. This system showed promising results with an accuracy, sensitivity and specificity of 90.6%, 0.90977 and 0.99668 respectively. Real-time applications were also considered, with the system achieving a maximum speed of 19.6 FPS on an MSI GTX 1060 GPU with 4GB of VRAM allocated.

[1]  Danny Crookes,et al.  An Environment for Rapid Derivatives Design and Experimentation , 2016, IEEE Journal of Selected Topics in Signal Processing.

[2]  Ali Farhadi,et al.  You Only Look Once: Unified, Real-Time Object Detection , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[3]  Trevor Darrell,et al.  Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation , 2013, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[4]  Dumitru Erhan,et al.  Going deeper with convolutions , 2014, 2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[5]  Sergey Ioffe,et al.  Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shift , 2015, ICML.

[6]  Ahmed Bouridane,et al.  Face Recognition in the Scrambled Domain via Salience-Aware Ensembles of Many Kernels , 2016, IEEE Transactions on Information Forensics and Security.

[7]  Danny Crookes,et al.  Live-Cell Tracking Using SIFT Features in DIC Microscopic Videos , 2010, IEEE Transactions on Biomedical Engineering.

[8]  Kaiming He,et al.  Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Keith Hall,et al.  The 2015 Long-Term Budget Outlook , 2015 .

[10]  Richard M. Jiang,et al.  Human silhouette extraction on FPGAs for infrared night vision military surveillance , 2010, 2010 Second Pacific-Asia Conference on Circuits, Communications and System.

[11]  Danny Crookes,et al.  Face Recognition in Global Harmonic Subspace , 2010, IEEE Transactions on Information Forensics and Security.

[12]  Danny Crookes,et al.  Date of publication xxxx 00, 0000, date of current version xxxx 00, 0000 , 2019 .

[13]  Simon Haykin,et al.  GradientBased Learning Applied to Document Recognition , 2001 .

[14]  Plamen Angelov,et al.  Deep Learning-Based Automated Forest Health Diagnosis From Aerial Images , 2020, IEEE Access.

[15]  Guido Pusiol,et al.  Computer Vision-based Approach to Maintain Independent Living for Seniors , 2017, AMIA.

[16]  C. Brayne,et al.  Inability to get up after falling, subsequent time on floor, and summoning help: prospective cohort study in people over 90 , 2008, BMJ : British Medical Journal.

[17]  Ahmed Bouridane,et al.  Emotion recognition from scrambled facial images via many graph embedding , 2017, Pattern Recognit..

[18]  Iasonas Kokkinos,et al.  DensePose: Dense Human Pose Estimation in the Wild , 2018, 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition.

[19]  Lambros Lazuras,et al.  A survey on the training needs of caregivers in five European countries. , 2020, Journal of nursing management.

[20]  Ahmed Bouridane,et al.  Robust human silhouette extraction with Laplacian fitting , 2014, Pattern Recognit. Lett..

[21]  Danny Crookes,et al.  Deep Salience: Visual Salience Modeling via Deep Belief Propagation , 2014, AAAI.

[22]  Ignacio Arganda-Carreras,et al.  Vision-Based Fall Detection with Convolutional Neural Networks , 2017, Wirel. Commun. Mob. Comput..

[23]  S. Cummings,et al.  The future of hip fractures in the United States. Numbers, costs, and potential effects of postmenopausal estrogen. , 1990, Clinical orthopaedics and related research.

[24]  Ahmed Bouridane,et al.  Role for 2D image generated 3D face models in the rehabilitation of facial palsy , 2017, Healthcare technology letters.

[25]  Danny Crookes,et al.  Using signed digit arithmetic for low-power multiplication , 2007 .

[26]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[27]  Ahmed Bouridane,et al.  3DPalsyNet: A Facial Palsy Grading and Motion Recognition Framework Using Fully 3D Convolutional Neural Networks , 2019, IEEE Access.

[28]  Ali Farhadi,et al.  YOLO9000: Better, Faster, Stronger , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[29]  Danny Crookes,et al.  Social Behavioral Phenotyping of Drosophila With a 2D–3D Hybrid CNN Framework , 2019, IEEE Access.

[30]  Xiaogang Li,et al.  Fall detection for elderly person care using convolutional neural networks , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[31]  Ross B. Girshick,et al.  Mask R-CNN , 2017, 1703.06870.

[32]  Somaya Al-Máadeed,et al.  Low-quality facial biometric verification via dictionary-based random pooling , 2016, Pattern Recognit..

[33]  Danny Crookes,et al.  Multimodal Biometric Human Recognition for Perceptual Human–Computer Interaction , 2010, IEEE Transactions on Systems, Man, and Cybernetics, Part C (Applications and Reviews).

[34]  Zelun Luo,et al.  Vision-Based Approach to Senior Healthcare : Depth-Based Activity Recognition with Convolutional Neural Networks , 2017 .

[35]  Danny Crookes,et al.  Visual Saliency Estimation through Manifold Learning , 2012, AAAI.

[36]  Ahmed Bouridane,et al.  Privacy-Protected Facial Biometric Verification Using Fuzzy Forest Learning , 2016, IEEE Transactions on Fuzzy Systems.