Detection of Semantic Risk Situations in Lifelog Data for Improving Life of Frail People

The automatic recognition of risk situations for frail people is an urgent research topic for the interdisciplinary artificial intelligence and multimedia community. Risky situations can be recognized from lifelog data recorded with wearable devices. In this paper, we present a new approach for the detection of semantic risk situations for frail people in lifelog data. Concept matching between general lifelog and risk taxonomies was realized and tuned AlexNet was deployed for detection of two semantic risks situations such as risk of domestic accident and risk of fraud with promising results.

[1]  Hsinchun Chen,et al.  SilverLink: Developing an International Smart and Connected Home Monitoring System for Senior Care , 2016, ICSH.

[2]  Edward Sazonov,et al.  Automatic Recognition of Activities of Daily Living Utilizing Insole-Based and Wrist-Worn Wearable Sensors , 2018, IEEE Journal of Biomedical and Health Informatics.

[3]  M. Tinetti,et al.  The patient who falls: "It's always a trade-off". , 2010, JAMA.

[4]  Farhaan Mirza,et al.  A Systematic Review of Wearable Sensors and IoT-Based Monitoring Applications for Older Adults – a Focus on Ageing Population and Independent Living , 2019, Journal of Medical Systems.

[5]  Petia Radeva,et al.  Social Relation Recognition in Egocentric Photostreams , 2019, 2019 IEEE International Conference on Image Processing (ICIP).

[6]  Geoffrey E. Hinton,et al.  ImageNet classification with deep convolutional neural networks , 2012, Commun. ACM.

[7]  Hermie Hermens,et al.  Usability in telemedicine systems - A literature survey , 2016, Int. J. Medical Informatics.

[8]  H. Amièva,et al.  Frailty among community-dwelling elderly people in France: the three-city study. , 2008, The journals of gerontology. Series A, Biological sciences and medical sciences.

[9]  Shivkumar Sabesan,et al.  Improving long‐term management of epilepsy using a wearable multimodal seizure detection system , 2015, Epilepsy & Behavior.

[10]  Alan F. Smeaton,et al.  Experiences of Aiding Autobiographical Memory Using the SenseCam , 2012, Hum. Comput. Interact..

[11]  Manuel Esteve,et al.  Fall detection system for elderly people using IoT and ensemble machine learning algorithm , 2019, Personal and Ubiquitous Computing.

[12]  Kok Kiong Tan,et al.  Power-Efficient Interrupt-Driven Algorithms for Fall Detection and Classification of Activities of Daily Living , 2015, IEEE Sensors Journal.

[13]  N. Fedarko.  The biology of aging and frailty. , 2011, Clinics in geriatric medicine.

[14]  Estefanía Talavera Martínez.  Towards Unsupervised Familiar Scene Recognition in Egocentric Videos , 2015 .

[15]  Minh-Triet Tran,et al.  [Invited papers] Comparing Approaches to Interactive Lifelog Search at the Lifelog Search Challenge (LSC2018) , 2019, ITE Transactions on Media Technology and Applications.

[16]  Zheng Zhang,et al.  MXNet: A Flexible and Efficient Machine Learning Library for Heterogeneous Distributed Systems , 2015, ArXiv.

[17]  Jenny Benois-Pineau,et al.  Perceptually-guided deep neural networks for ego-action prediction: Object grasping , 2019, Pattern Recognit..

[18]  Rami Albatal,et al.  A Test Collection for Interactive Lifelog Retrieval , 2019, MMM.

[19]  Jenny Benois-Pineau,et al.  Saliency-based selection of visual content for deep convolutional neural networks , 2018, Multimedia Tools and Applications.

[20]  Emiliano Sisinni,et al.  Remote and non-invasive monitoring of elderly in a smart city context , 2018, 2018 IEEE Sensors Applications Symposium (SAS).

[21]  Trevor Darrell,et al.  Caffe: Convolutional Architecture for Fast Feature Embedding , 2014, ACM Multimedia.

[22]  Paola Pierleoni,et al.  A High Reliability Wearable Device for Elderly Fall Detection , 2015, IEEE Sensors Journal.

[23]  Jian Sun,et al.  Deep Residual Learning for Image Recognition , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[24]  Jenny Benois-Pineau,et al.  Multi-sensing of fragile persons for risk situation detection: devices, methods, challenges , 2019, 2019 International Conference on Content-Based Multimedia Indexing (CBMI).

[25]  Thobias Sando,et al.  GIS-based Spatial and Temporal Analysis of Aging-Involved Accidents: a Case Study of Three Counties in Florida , 2017 .

[26]  Ruchuan Wang,et al.  TagCare: Using RFIDs to Monitor the Status of the Elderly Living Alone , 2017, IEEE Access.

[27]  Heedong Ko,et al.  Data-Driven Smart Home System for Elderly People Based on Web Technologies , 2016, HCI.

[28]  Edward Sazonov,et al.  SmartStep: A Fully Integrated, Low-Power Insole Monitor , 2014 .

[29]  Chao Wang,et al.  A Novel Dynamic Spectrum Access Framework Based on Reinforcement Learning for Cognitive Radio Sensor Networks , 2016, Sensors.

[30]  Parisa Rashidi,et al.  A smartwatch-based framework for real-time and online assessment and mobility monitoring , 2019, J. Biomed. Informatics.

[31]  Víctor M. González Suárez,et al.  Improving Fall Detection Using an On-Wrist Wearable Accelerometer , 2018, Sensors.