Study of multiple moving targets’ detection in fisheye video based on the moving blob model

This paper discussed some improved algorithms for multiple moving targets detection and tracking in fisheye video sequences which based on the moving blob model. The view field of fisheye lens achieved 183 degree which used in our system, so it has more effective in the no blind surveillance system. However, the fisheye image has a big distortion that makes it difficult to achieve an intelligent function. In this paper we try to establish a moving blob model to detect and track multiple moving targets in the fisheye video sequences, in order to achieve the automation and intelligent ability for no blind surveillance system. It is divided into three steps. Firstly, the distortion model of fisheye lens was established, we are discussing the character of the imaging principle of fisheye lens, and calculate the distortion coefficient which can be used in the moving blob model. Secondly, the principle of the moving blob model was analyzed in detail which based on the fisheye distortion model. It was included four main algorithms, which the first is the traditional algorithm of background extraction; and the background updating algorithm; the algorithm of the fisheye video sequence with the background subtracted in order to get the moving blobs; the algorithm of removing the shadow of blobs in RGB space. Thirdly, we determined that every extracted blob is a real moving target by calculating the pixels with a threshold, which can discard the faulty moving targets. Lastly, we designed the algorithm for tracking the moving targets based on the moving blobs selected through calculating the geometry center. The experiment indicated that every algorithm has a better processing efficiency of multiple moving targets in fisheye video sequences. Compared the traditional algorithm, the improved algorithm can be detected the moving target in a circular fisheye image effectively and stably.

[1]  Jin Wei,et al.  Fisheye Video Correction , 2012, IEEE Transactions on Visualization and Computer Graphics.

[2]  Amar Mitiche,et al.  On convergence of the Horn and Schunck optical-flow estimation method , 2004, IEEE Transactions on Image Processing.

[3]  Daniel Cremers,et al.  An Improved Algorithm for TV-L 1 Optical Flow , 2009, Statistical and Geometrical Approaches to Visual Motion Analysis.

[4]  Huan Du,et al.  Improving RGBD Saliency Detection Using Progressive Region Classification and Saliency Fusion , 2016, IEEE Access.

[5]  Donald B. Gennery,et al.  Generalized Camera Calibration Including Fish-Eye Lenses , 2006, International Journal of Computer Vision.

[6]  Ke Sun,et al.  Fast lane detection based on bird’s eye view and improved random sample consensus algorithm , 2016, Multimedia Tools and Applications.

[7]  Li-fen Tu,et al.  Moving object detection method based on complementary multi resolution background models , 2014 .

[8]  Zhou He-qin Vehicle Detection and Recognition in Multi-traffic Scenes , 2004 .

[9]  Mohammad Ali Zare Chahooki,et al.  Bridging the semantic gap for automatic image annotation by learning the manifold space , 2015, Comput. Syst. Sci. Eng..

[10]  Dorin Comaniciu,et al.  Real-time tracking of non-rigid objects using mean shift , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[11]  Edward Jones,et al.  Equidistant Fish-Eye Calibration and Rectification by Vanishing Point Extraction , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[12]  Ying Xiang Fisheye Lense Distortion Correction Using Spherical Perspective Projection Constraint , 2003 .

[13]  Xie Qinlan Camshift and Kalman Predicting Based on Moving Target Tracking , 2010 .

[14]  Yucheng Liu,et al.  A Surround View Camera Solution for Embedded Systems , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[15]  Yongduan Song,et al.  Automatic surveillance system using fish-eye lens camera , 2011 .

[16]  Wei Shen,et al.  Moving object detection in framework of compressive sampling , 2010 .

[17]  Sek M. Chai,et al.  Real-Time Fisheye Lens Distortion Correction Using Automatically Generated Streaming Accelerators , 2009, 2009 17th IEEE Symposium on Field Programmable Custom Computing Machines.

[18]  Jianhui Wu,et al.  Study the Moving Objects Extraction and Tracking Used the Moving Blobs Method in Fisheye Image , 2014, CCPR.

[19]  Frank Nielsen,et al.  Surround video: a multihead camera approach , 2005, The Visual Computer.

[20]  Xiaolong Zhang,et al.  Cursor caging: enhancing focus targeting in interactive fisheye views , 2013, Science China Information Sciences.

[21]  Juho Kannala,et al.  A generic camera model and calibration method for conventional, wide-angle, and fish-eye lenses , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Ming-Shi Wang,et al.  A Vision Based Top-View Transformation Model for a Vehicle Parking Assistant , 2012, Sensors.

[23]  Gyeong-il Kweon,et al.  Fisheye Lens for Image Processing Applications , 2008 .

[24]  Simon X. Yang,et al.  Fast-moving target tracking based on mean shift and frame-difference methods , 2011 .

[25]  Fei Wang,et al.  Multiple-target tracking with adaptive sampling intervals for phased-array radar , 2011 .