FALL DETECTION USING MODULAR NEURAL NETWORKS WITH BACK-PROJECTED OPTICAL FLOW

This paper presents a video-based algorithm for fall detection used the modular neural networks with the motion vectors computed by block-based optical flow back-projection (BOFB). From a video sequence, the moving object is extracted first and the pixels with high intensity variance in the extracted object are determined as feature points. The motion vector in this application is required to represent the actual motion displacement, rather than visually significant similarity. Therefore, we proposed BOFB which back-projects optical flows in a block to restore the motion vector from gradient-based optical flows that is employed to estimate the genuine motion of these feature points. The sequences of feature vectors are fed into the proposed Time-Delay Hierarchical modular Neural Network (TDHNN) for fall detection. The TDHNN consists of two major modular networks: several Time-Delay Neural Networks (TDNNs) trained by various feature characteristics and a Support Vector Machine (SVM) for final decision. This paper also purposed Slide Window Accumulate (SWA) mechanism for the increase of the robustness of the system in fall detection. The experimental results show that the proposed algorithm is efficacious and reliable in fall detection.

[1]  Yücel Altunbasak,et al.  A fast parametric motion estimation algorithm with illumination and lens distortion correction , 2003, IEEE Trans. Image Process..

[2]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[3]  Yap-Peng Tan,et al.  Fall Incidents Detection for Intelligent Video Surveillance , 2005, 2005 5th International Conference on Information Communications & Signal Processing.

[4]  Shih-Yu Huang,et al.  Computation-aware scheme for software-based block motion estimation , 2003, IEEE Trans. Circuits Syst. Video Technol..

[5]  Roberto Battiti,et al.  First- and Second-Order Methods for Learning: Between Steepest Descent and Newton's Method , 1992, Neural Computation.

[6]  P.-C. Chung,et al.  Optical flow back-projection for genuine motion vector estimation , 2004, 2004 IEEE International Conference on Multimedia and Expo (ICME) (IEEE Cat. No.04TH8763).

[7]  Pau-Choo Chung,et al.  A spatiotemporal neural network for recognizing partially occluded objects , 1998, IEEE Trans. Signal Process..

[8]  Neil Johnson,et al.  A smart sensor to detect the falls of the elderly , 2004, IEEE Pervasive Computing.

[9]  Michael G. Strintzis,et al.  Video scene segmentation using spatial contours and 3-D robust motion estimation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[10]  Pierre Moulin,et al.  Multiscale modeling and estimation of motion fields for video coding , 1997, IEEE Trans. Image Process..

[11]  Brian G. Schunck,et al.  Image Flow Segmentation and Estimation by Constraint Line Clustering , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[12]  John J. Hopfield,et al.  Connected-digit speaker-dependent speech recognition using a neural network with time-delayed connections , 1991, IEEE Trans. Signal Process..

[13]  Lai-Man Po,et al.  Enhanced hexagonal search for fast block motion estimation , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Ahmed El Oirrak,et al.  Estimation of general 2D affine motion using Fourier descriptors , 2002, Pattern Recognit..

[15]  David J. Fleet,et al.  Performance of optical flow techniques , 1994, International Journal of Computer Vision.

[16]  Chih-Jen Lin,et al.  Combining SVMs with Various Feature Selection Strategies , 2006, Feature Extraction.

[17]  Pau-Choo Chung,et al.  Optical flow back-projection for genuine motion vector estimation , 2004 .