Robust spatio-temporal descriptors for real-time SVM-based fall detection

We propose a SVM-based approach to detect falls in several home environments using an optimised descriptor adapted to real-time tasks.We build an optimised spatio-temporal descriptor named STHFa_SBFS using several combinations of transformations of geometrical features, thanks to feature selection. We study the combinations of usual transformations of the features (Fourier Transform, Wavelet transform, first and second derivatives). Automatic feature selection allows to show that the best tradeoff between classification performance and processing time is obtained combining the original low-level features with their first derivative. Hence, we evaluate the robustness of the fall detection regarding location changes. We propose a realistic and pragmatic protocol which enables performance to be improved by updating the training in the current location with normal activities records. An embedded implementation of the fall detection based on a smart camera prototype is briefly depicted and demonstrates that a compact version of the detector can be deployed.

[1]  Anil K. Jain,et al.  Feature Selection: Evaluation, Application, and Small Sample Performance , 1997, IEEE Trans. Pattern Anal. Mach. Intell..

[2]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[3]  Jiaxing Li,et al.  Development of a Fall Detection System with Microsoft Kinect , 2012, RiTA.

[4]  A. Bourke,et al.  Fall detection - Principles and Methods , 2007, 2007 29th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  Yap-Peng Tan,et al.  Fall Incidents Detection for Intelligent Video Surveillance , 2005, 2005 5th International Conference on Information Communications & Signal Processing.

[6]  Jia Liu,et al.  Action recognition using spatiotemporal features and hybrid generative/discriminative models , 2012, J. Electronic Imaging.

[7]  Yoav Freund,et al.  Experiments with a New Boosting Algorithm , 1996, ICML.

[8]  Ping-Min Lin,et al.  A fall detection system using k-nearest neighbor classifier , 2010, Expert Syst. Appl..

[9]  Alessandro Leone,et al.  Detecting falls with 3D range camera in ambient assisted living applications: a preliminary study. , 2011, Medical engineering & physics.

[10]  Lalit M. Patnaik,et al.  Classification of magnetic resonance brain images using wavelets as input to support vector machine and neural network , 2006, Biomed. Signal Process. Control..

[11]  Syed Abdul Rahman Syed Abu Bakar,et al.  Integration of projection histograms and linear prediction for object tracking , 2003 .

[12]  Chittaranjan A. Mandal,et al.  Automatic Detection of Human Fall in Video , 2007, PReMI.

[13]  Ingrid Daubechies,et al.  Ten Lectures on Wavelets , 1992 .

[14]  G. Wu,et al.  Distinguishing fall activities from normal activities by velocity characteristics. , 2000, Journal of biomechanics.

[15]  T. Goedemé,et al.  A Video-based Algorithm for Elderly Fall Detection , 2009 .

[16]  Vladimir Cherkassky,et al.  The Nature Of Statistical Learning Theory , 1997, IEEE Trans. Neural Networks.

[17]  Stephen J. McKenna,et al.  Activity summarisation and fall detection in a supportive home environment , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[18]  Hafiz Adnan Habib,et al.  Video Analytic for Fall Detection from Shape Features and Motion Gradients , 2009 .

[19]  A. Enis Çetin,et al.  HMM Based Falling Person Detection Using Both Audio and Video , 2005, 2006 IEEE 14th Signal Processing and Communications Applications.

[20]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[21]  Nicolas Thome,et al.  A Real-Time, Multiview Fall Detection System: A LHMM-Based Approach , 2008, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Arnaldo de Albuquerque Araújo,et al.  Violence Detection in Video Using Spatio-Temporal Features , 2010, 2010 23rd SIBGRAPI Conference on Graphics, Patterns and Images.

[23]  Paul A. Viola,et al.  Robust Real-Time Face Detection , 2001, International Journal of Computer Vision.

[24]  Mohamed Abid,et al.  An FPGA-based accelerator for Fourier Descriptors computing for color object recognition using SVM , 2007, Journal of Real-Time Image Processing.

[25]  Alireza Rezvanian,et al.  Robust Fall Detection Using Human Shape and Multi-class Support Vector Machine , 2008, 2008 Sixth Indian Conference on Computer Vision, Graphics & Image Processing.

[26]  Jean Meunier,et al.  Robust Video Surveillance for Fall Detection Based on Human Shape Deformation , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[27]  Yang Wang,et al.  Hidden Part Models for Human Action Recognition: Probabilistic versus Max Margin , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[28]  Balasubramanian Raman,et al.  Recognizing human gestures using a novel SVM tree , 2012, Other Conferences.

[29]  B. Ugur Toreyin,et al.  Ses ve video işaretlerinde saklı markof modeli tabanlı düşen kişi tespiti , 2006 .

[30]  Johel Mitéran,et al.  Classification of prostate magnetic resonance spectra using Support Vector Machine , 2012, Biomed. Signal Process. Control..

[31]  Terry Caelli,et al.  On the Representation of Visual Information , 2001, IWVF.

[32]  Fabrice Mériaudeau,et al.  Real-time flaw detection on a complex object: comparison of results using classification with a support vector machine, boosting, and hyperrectangle-based method , 2006, J. Electronic Imaging.

[33]  Chung-Lin Huang,et al.  Slip and fall event detection using Bayesian Belief Network , 2012, Pattern Recognit..

[34]  Jean Meunier,et al.  3D head tracking for fall detection using a single calibrated camera , 2013, Image Vis. Comput..

[35]  Zhihai He,et al.  Recognizing Falls from Silhouettes , 2006, 2006 International Conference of the IEEE Engineering in Medicine and Biology Society.

[36]  Chenyang Zhang,et al.  RGB-D Camera-based Daily Living Activity Recognition , 2022 .

[37]  Jiri Matas,et al.  Automatic Hardware Implementation Tool for a Discrete Adaboost-Based Decision Algorithm , 2005, EURASIP J. Adv. Signal Process..

[38]  Qi Tian,et al.  Foreground object detection from videos containing complex background , 2003, MULTIMEDIA '03.