A Low Cost and Computationally Efficient Approach for Occlusion Handling in Video Surveillance Systems

I recent times quest for development of intelligent security systems has become the need of the hour for making residential and office premises safer. Due to increasing threat from different types of activities leading to breach of security, it has become impossible for conventional security systems to detect such activities and alert security system in advance. Thus, an increasing reliance on surveillance systems has resulted in need for better target detection and tracking techniques. Methods such as Radio Frequency Identification (RFID) tracking are not useful in preventing above mentioned situations; hence there is a need of wide area surveillance. Target tracking via image processing for a video surveillance system provides an attractive solution, which can efficiently track a specific target, record its position throughout the video stream and also analyze its motion pattern. Video tracking is the process of locating a moving object (or multiple objects) over time using a camera. It has a variety of uses, some of which are; human-computer interaction [1], security and surveillance [2] [3], video communication and compression [4], augmented reality [5], traffic control [6] [7], medical imaging [8] [9], video editing [10] [11], multimedia contexts [12] [13], complex object movements [14], video streaming [15], healthcare systems and smart indoor security systems. Video tracking is a time consuming process due to the amount of data that is captured and needs to be processed. Further, the algorithm complexity increases if object recognition for tracking is also involved. The objective of video tracking is to maintain detectability of target object in consecutive video frames. To perform video tracking, an algorithm analyses sequential video frames and outputs the movement of targets between the frames. There are a variety of algorithms, each having its strengths and weaknesses. Considering the intended use, it is important to choose the algorithm best suited for the serving the purpose. Traditional tracking algorithms involve foreground extraction of the moving target from a static background and then tracks the coherent blobs of the target. Though, these algorithms are computationally efficient but track all the vehicles which exhibit motion in the stream. Similarly, other tracking algorithms like optical flow techniques as discussed in [16] and wavelet based vehicle tracking as illustrated in [17] also track all the vehicles which exhibit motion or all that are similar in appearance. The lighting condition varies throughout the whole day (depending upon the weather condition for outdoor and lights for indoor). Low light conditions result into poor discrimination of objects from their background and sometimes lighting condition causes shadows or white-out effect. Most of the background subtraction techniques are sensitive to illumination change and it is difficult to handle the shade and shadow caused by the illumination change. Most algorithms which are able to handle these situations, need time on the order of several frames to estimate and train the background model [18]. Less work Keywords

[1]  Jitendra Malik,et al.  A real-time computer vision system for measuring traffic parameters , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Tarek Sayed,et al.  A feature-based tracking algorithm for vehicles in intersections , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[3]  Rui Caseiro,et al.  High-Speed Tracking with Kernelized Correlation Filters , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Dorin Comaniciu,et al.  Kernel-Based Object Tracking , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[5]  Alfredo Petrosino,et al.  The Matrioska Tracking Algorithm on LTDT2014 Dataset , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[6]  Pengfei Shi,et al.  An Algorithm for License Plate Recognition Applied to Intelligent Transportation System , 2011, IEEE Transactions on Intelligent Transportation Systems.

[7]  Hans-Werner Gellersen,et al.  Toward Mobile Eye-Based Human-Computer Interaction , 2010, IEEE Pervasive Computing.

[8]  Laura Sevilla-Lara,et al.  Distribution fields for tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[9]  Michael Felsberg,et al.  Learning Spatially Regularized Correlation Filters for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[10]  Geoffrey D. Sullivan,et al.  Model-Based Tracking , 2011, BMVC.

[11]  Harpreet Kaur,et al.  Vehicle Tracking in Video Using Fractional Feedback Kalman Filter , 2016, IEEE Transactions on Computational Imaging.

[12]  Chong-Wah Ngo,et al.  Gesture tracking and recognition for lecture video editing , 2004, Proceedings of the 17th International Conference on Pattern Recognition, 2004. ICPR 2004..

[13]  Snehasis Mukherjee,et al.  Multiple object tracking by improved KLT tracker over SURF features , 2015, 2015 Fifth National Conference on Computer Vision, Pattern Recognition, Image Processing and Graphics (NCVPRIPG).

[14]  Haibin Ling,et al.  SANet: Structure-Aware Network for Visual Tracking , 2016, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[15]  Arnold W. M. Smeulders,et al.  UvA-DARE (Digital Academic Repository) Siamese Instance Search for Tracking , 2016 .

[16]  Ujjwal Baid,et al.  An approach to automatic object tracking system by combination of SIFT and RANSAC with mean shift and KLT , 2016, 2016 Conference on Advances in Signal Processing (CASP).

[17]  Ming-Hsuan Yang,et al.  Hierarchical Convolutional Features for Visual Tracking , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[18]  Aggelos K. Katsaggelos,et al.  Low-Complexity Tracking-Aware H.264 Video Compression for Transportation Surveillance , 2011, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Rahmat Ullah,et al.  A Comparison of FAST, SURF, Eigen, Harris, and MSER Features , 2016 .

[20]  Haim Schweitzer,et al.  A Dual-Bound Algorithm for Very Fast and Exact Template Matching , 2011, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Anna Hilsmann,et al.  A Hybrid Approach for Facial Performance Analysis and Editing , 2017, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Young Hoon Joo,et al.  Fast and robust algorithm of tracking multiple moving objects for intelligent video surveillance systems , 2011, IEEE Transactions on Consumer Electronics.

[23]  Shuicheng Yan,et al.  Body Surface Context: A New Robust Feature for Action Recognition From Depth Videos , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[24]  Gérard G. Medioni,et al.  Context tracker: Exploring supporters and distracters in unconstrained environments , 2011, CVPR 2011.

[25]  Vincent Lepetit,et al.  BRIEF: Computing a Local Binary Descriptor Very Fast , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Shaharyar Kamal,et al.  Real-time life logging via a depth silhouette-based human activity recognition system for smart home services , 2014, 2014 11th IEEE International Conference on Advanced Video and Signal Based Surveillance (AVSS).

[27]  Rui Chen,et al.  A object tracking method in two cameras with common view field , 2017, 2017 10th International Congress on Image and Signal Processing, BioMedical Engineering and Informatics (CISP-BMEI).

[28]  P. KaewTrakulPong,et al.  An Improved Adaptive Background Mixture Model for Real-time Tracking with Shadow Detection , 2002 .

[29]  Shang-Hong Lai,et al.  Fast Template Matching Based on Normalized Cross Correlation With Adaptive Multilevel Winner Update , 2008, IEEE Transactions on Image Processing.

[30]  Allen Y. Yang,et al.  Distributed segmentation and classification of human actions using a wearable motion sensor network , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[31]  Bohyung Han,et al.  Learning Multi-domain Convolutional Neural Networks for Visual Tracking , 2015, 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).

[32]  Haibin Ling,et al.  Parallel Tracking and Verifying: A Framework for Real-Time and High Accuracy Visual Tracking , 2017, 2017 IEEE International Conference on Computer Vision (ICCV).

[33]  Vinod Pankajakshan,et al.  Tucker tensor decomposition-based tracking and Gaussian mixture model for anomaly localisation and detection in surveillance videos , 2018, IET Comput. Vis..

[34]  Mei Tian,et al.  Joint Headlight Pairing and Vehicle Tracking by Weighted Set Packing in Nighttime Traffic Videos , 2018, IEEE Transactions on Intelligent Transportation Systems.

[35]  Teruhisa Misu,et al.  Driver Behavior and Performance with Augmented Reality Pedestrian Collision Warning: An Outdoor User Study , 2018, IEEE Transactions on Visualization and Computer Graphics.

[36]  Ming-Hsuan Yang,et al.  Object Tracking Benchmark , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[37]  Peter Auer,et al.  Generic object recognition with boosting , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[38]  Muhammad Ghulam,et al.  Medical Image Forgery Detection for Smart Healthcare , 2018, IEEE Communications Magazine.

[39]  Teddy Ko,et al.  A survey on behavior analysis in video surveillance for homeland security applications , 2008, 2008 37th IEEE Applied Imagery Pattern Recognition Workshop.

[40]  Wonjun Kim,et al.  Illumination-Invariant Background Subtraction: Comparative Review, Models, and Prospects , 2017, IEEE Access.

[41]  Daijin Kim,et al.  Shape and Motion Features Approach for Activity Tracking and Recognition from Kinect Video Camera , 2015, 2015 IEEE 29th International Conference on Advanced Information Networking and Applications Workshops.

[42]  T. Poggio,et al.  A Contour-Based Moving Object Detection and Tracking , 2005, 2005 IEEE International Workshop on Visual Surveillance and Performance Evaluation of Tracking and Surveillance.

[43]  G LoweDavid,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004 .

[44]  Wei An,et al.  Object Tracking Using Multiple Features and Adaptive Model Updating , 2017, IEEE Transactions on Instrumentation and Measurement.

[45]  Shai Avidan,et al.  Locally Orderless Tracking , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.

[46]  Zdenek Kalal,et al.  Tracking-Learning-Detection , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[47]  I. V. Borisova,et al.  Target tracking based on object's shape , 2016, 2016 11th International Forum on Strategic Technology (IFOST).

[48]  Frank Brown,et al.  University of North Carolina at Chapel Hill School of Education Educational Leadership Program EDUC 831.001 & .957 School Law , 2009 .

[49]  J. L. Roux An Introduction to the Kalman Filter , 2003 .

[50]  Sevan Harput,et al.  Two-Stage Motion Correction for Super-Resolution Ultrasound Imaging in Human Lower Limb , 2018, IEEE Transactions on Ultrasonics, Ferroelectrics, and Frequency Control.

[51]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[52]  Tobias Senst,et al.  Robust Local Optical Flow for Feature Tracking , 2012, IEEE Transactions on Circuits and Systems for Video Technology.

[53]  Cordelia Schmid,et al.  Online Object Tracking with Proposal Selection , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[54]  Gérard G. Medioni,et al.  Online Tracking and Reacquisition Using Co-trained Generative and Discriminative Trackers , 2008, ECCV.

[55]  Shengyong Chen,et al.  Robust Object Tracking via Large Margin and Scale-Adaptive Correlation Filter , 2018, IEEE Access.

[56]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[57]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[58]  M. M. Naushad Ali,et al.  Multiple object tracking with partial occlusion handling using salient feature points , 2014, Inf. Sci..

[59]  Li Zhang,et al.  Towards Occlusion Handling: Object Tracking With Background Estimation , 2018, IEEE Transactions on Cybernetics.

[60]  Kwang-Yeob Lee,et al.  Wavelet-based vehicle tracking for automatic traffic surveillance , 2001, Proceedings of IEEE Region 10 International Conference on Electrical and Electronic Technology. TENCON 2001 (Cat. No.01CH37239).

[61]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[62]  Stan Sclaroff,et al.  MEEM: Robust Tracking via Multiple Experts Using Entropy Minimization , 2014, ECCV.