A Biologically Inspired Vision-Based Approach for Detecting Multiple Moving Objects in Complex Outdoor Scenes

In the human brain, independent components of optical flows from the medial superior temporal area are speculated for motion cognition. Inspired by this hypothesis, a novel approach combining independent component analysis (ICA) with principal component analysis (PCA) is proposed in this paper for multiple moving objects detection in complex scenes—a major real-time challenge as bad weather or dynamic background can seriously influence the results of motion detection. In the proposed approach, by taking advantage of ICA’s capability of separating the statistically independent features from signals, the ICA algorithm is initially employed to analyze the optical flows of consecutive visual image frames. As a result, the optical flows of background and foreground can be approximately separated. Since there are still many disturbances in the foreground optical flows in the complex scene, PCA is then applied to the optical flows of foreground components so that major optical flows corresponding to multiple moving objects can be enhanced effectively and the motions resulted from the changing background and small disturbances are relatively suppressed at the same time. Comparative experimental results with existing popular motion detection methods for challenging imaging sequences demonstrate that our proposed biologically inspired vision-based approach can extract multiple moving objects effectively in a complex scene.

[1]  T J Sejnowski,et al.  A Model for Encoding Multiple Object Motions and Self-Motion in Area MST of Primate Visual Cortex , 1998, The Journal of Neuroscience.

[2]  Thierry Bouwmans,et al.  Robust PCA via Principal Component Pursuit: A review for a comparative evaluation in video surveillance , 2014, Comput. Vis. Image Underst..

[3]  Rachid Deriche,et al.  Geodesic Active Contours and Level Sets for the Detection and Tracking of Moving Objects , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.

[5]  Michael J. Black,et al.  Secrets of optical flow estimation and their principles , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[6]  Guido C. H. E. de Croon,et al.  Adaptive Gaze Control for Object Detection , 2011, Cognitive Computation.

[7]  Marko Heikkilä,et al.  A texture-based method for modeling the background and detecting moving objects , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  Michael G. Rabbat,et al.  Background Subtraction for Online Calibration of Baseline RSS in RF Sensing Networks , 2012, IEEE Transactions on Mobile Computing.

[9]  Z. Zivkovic Improved adaptive Gaussian mixture model for background subtraction , 2004, ICPR 2004.

[10]  Atsushi Imiya,et al.  Independent component analysis of optical flow for robot navigation , 2008, Neurocomputing.

[11]  Richard Szeliski,et al.  A Database and Evaluation Methodology for Optical Flow , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[12]  Dar-Shyang Lee,et al.  Effective Gaussian mixture learning for video background subtraction , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Marc Van Droogenbroeck,et al.  ViBe: A Universal Background Subtraction Algorithm for Video Sequences , 2011, IEEE Transactions on Image Processing.

[14]  Hubert Konik,et al.  A Spatiotemporal Saliency Model for Video Surveillance , 2011, Cognitive Computation.

[15]  W. Eric L. Grimson,et al.  Learning Patterns of Activity Using Real-Time Tracking , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Atsushi Imiya,et al.  Dominant plane detection from optical flow for robot navigation , 2006, Pattern Recognit. Lett..

[17]  Thierry Bouwmans,et al.  Foreground Detection by Robust PCA Solved via a Linearized Alternating Direction Method , 2012, ICIAR.

[18]  Simon K. Rushton,et al.  Optic Flow and Beyond , 2004 .

[19]  Yi Ma,et al.  Robust principal component analysis? , 2009, JACM.

[20]  Terrence J. Sejnowski,et al.  Properties of independent components of self-motion optical flow , 2000, Proceedings 30th IEEE International Symposium on Multiple-Valued Logic (ISMVL 2000).

[21]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[22]  Marwan A. Jabri,et al.  Independent Components of Optical Flows Have MSTd-Like Receptive Fields , 2000 .

[23]  Atsushi Shimada,et al.  Adaptive Background Modeling for Paused Object Regions , 2010, ACCV Workshops.

[24]  Q. M. Jonathan Wu,et al.  Multiresolution Based Gaussian Mixture Model for Background Suppression , 2013, IEEE Transactions on Image Processing.

[25]  Thierry Bouwmans,et al.  Subspace Learning for Background Modeling: A Survey , 2009 .

[26]  Radford M. Neal Pattern Recognition and Machine Learning , 2007, Technometrics.

[27]  Qian Du,et al.  A joint optical flow and principal component analysis approach for motion detection , 2010, 2010 IEEE International Conference on Acoustics, Speech and Signal Processing.

[28]  Erkki Oja,et al.  Independent component analysis: algorithms and applications , 2000, Neural Networks.

[29]  Touradj Ebrahimi,et al.  Video object extraction based on adaptive background and statistical change detection , 2000, IS&T/SPIE Electronic Imaging.