Silhouette based human fall detection using multimodal classifiers for content based video retrieval systems

Automatic human fall detections are proving the need of time in emergency situations for elderly persons falling on the floor injuring them, sometimes with bone fracture or more severely at times being alone while performing their daily activities. Recent advancement in image processing and therein activity identification is seeing rising trend of research. Present paper aims at putting forward a fall detection system which uses human silhouettes, as processed from depth cue based on camera footages, to extract curvature scale space (CSS) features. Human actions thus finally rendered into CSS are classified with the help of standard machine learning classifier techniques such as support vector machine (SVM) and extreme learning machine (ELM). Moreover, the paper distinctively puts forward the benefit of augmented ELM classifier with help of sparse representation for image frame classification (SRC) technique. The system had been tested with standard dataset as established in literature for human action classification. The results presented in form of confusion matrix comprising of detecting semantic activities like walking, idle sitting, standing and falling demonstrate that the developed system has an edge in terms of higher accuracy compared to similar state of the art methods as reported in literature.

[1]  Wanqing Li,et al.  Action recognition based on a bag of 3D points , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition - Workshops.

[2]  John Nelson,et al.  DESIGN AND TEST OF A LONG-TERM FALL DETECTION SYSTEM INCORPORATED INTO A CUSTOM VEST FOR THE ELDERLY. , 2008 .

[3]  Israel Gannot,et al.  A Method for Automatic Fall Detection of Elderly People Using Floor Vibrations and Sound—Proof of Concept on Human Mimicking Doll Falls , 2009, IEEE Transactions on Biomedical Engineering.

[4]  Farzin Mokhtarian,et al.  A Theory of Multiscale, Curvature-Based Shape Representation for Planar Curves , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Jeffrey M. Hausdorff,et al.  Comparison of acceleration signals of simulated and real-world backward falls. , 2011, Medical engineering & physics.

[6]  Minxia Luo,et al.  Ensemble extreme learning machine and sparse representation classification , 2016, J. Frankl. Inst..

[7]  Junji Yamato,et al.  Recognizing human action in time-sequential images using hidden Markov model , 1992, Proceedings 1992 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[8]  S. J. Redmond,et al.  Sensors-Based Wearable Systems for Monitoring of Human Movement and Falls , 2012, IEEE Sensors Journal.

[9]  Henk J. Stam,et al.  Ambulatory monitoring of mobility-related activities: the initial phase of the development of an activity monitor , 1995 .

[10]  Kamiar Aminian,et al.  Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly , 2003, IEEE Transactions on Biomedical Engineering.

[11]  A. A. Ghatol,et al.  Multicue Optimized Object Detection for Automatic Video Event Extraction , 2016 .

[12]  Ilias Maglogiannis,et al.  Emergency Fall Incidents Detection in Assisted Living Environments Utilizing Motion, Sound, and Visual Perceptual Components , 2011, IEEE Transactions on Information Technology in Biomedicine.

[13]  M. Mathie,et al.  A pilot study of long-term monitoring of human movements in the home using accelerometry , 2004, Journal of telemedicine and telecare.

[14]  K. Aminian,et al.  Physical activity monitoring based on accelerometry: validation and comparison with video observation , 1999, Medical & Biological Engineering & Computing.

[15]  M. Mathie,et al.  Detection of daily physical activities using a triaxial accelerometer , 2003, Medical and Biological Engineering and Computing.

[16]  Nigel H. Lovell,et al.  Implementation of a real-time human movement classifier using a triaxial accelerometer for ambulatory monitoring , 2006, IEEE Transactions on Information Technology in Biomedicine.

[17]  A. Bourke,et al.  The identification of vertical velocity profiles using an inertial sensor to investigate pre-impact detection of falls. , 2008, Medical Engineering and Physics.

[18]  A. A. Ghatol,et al.  Video Events Extraction based on Mixed Feature Modeling , 2017 .

[19]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[20]  Brijmohan Daga,et al.  Content Based Video Retrieval Using Color Feature: An Integration Approach , 2013 .

[21]  Jake K. Aggarwal,et al.  View invariant human action recognition using histograms of 3D joints , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[22]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.