Carried object detection in short video sequences

In this paper we propose an approach to carried object detection in short video sequences and overcome some of the shortcomings of other methods. The proposed approach can estimate pedestrian's walking direction accurately without manual calibration and classify the probable carried object pixels with no need for prior information. Pedestrian's silhouette is first aligned to get the temporal template. Then, the temporal template is matched against a set of exemplars using Principle Component Analysis (PCA) and exhaustive search. Finally, a fuzzy cluster method is applied to classify the protruding pixels. The method has been tested on PETS 2006 dataset and the detection of carried object is accurate and robust.

[1]  Rubén Heras Evangelio,et al.  Towards Detecting People Carrying Objects - A Periodicity Dependency Pattern Approach , 2010, VISAPP.

[2]  Rubén Heras Evangelio,et al.  Detecting people carrying objects based on an optical flow motion model , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[3]  Dima Damen,et al.  Detecting Carried Objects from Sequences of Walking Pedestrians , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Larry S. Davis,et al.  Real-time periodic motion detection, analysis, and applications , 1999, Proceedings. 1999 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No PR00149).

[5]  Larry S. Davis,et al.  Backpack: Detection of People Carrying Objects Using Silhouettes , 2001, Comput. Vis. Image Underst..

[6]  Larry S. Davis,et al.  Backpack: detection of people carrying objects using silhouettes , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Kuo-Chin Fan,et al.  Carried Object Detection Using Ratio Histogram and its Application to Suspicious Event Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[9]  Giovanni Attolico,et al.  Detection of objects carried by people , 2002, Proceedings. International Conference on Image Processing.

[10]  Larry Davis,et al.  Modelling pedestrian shapes for outlier detection: a neural net based approach , 2003, IEEE IV2003 Intelligent Vehicles Symposium. Proceedings (Cat. No.03TH8683).

[11]  Yue Qi,et al.  Carrying object detection and tracking based on body main axis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[12]  Xuelong Li,et al.  Human Carrying Status in Visual Surveillance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[13]  Dima Damen,et al.  Detecting Carried Objects in Short Video Sequences , 2008, ECCV.

[14]  Shin'ichi Satoh,et al.  Carried object detection using star skeleton with adaptive centroid and time series graph , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[15]  Ahmed M. Elgammal,et al.  Carrying Object Detection Using Pose Preserving Dynamic Shape Models , 2006, AMDO.

[16]  George Loizou,et al.  Computer vision and pattern recognition , 2007, Int. J. Comput. Math..

[17]  Larry S. Davis,et al.  Detection of people carrying objects : a motion-based recognition approach , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[18]  Tobias Senst,et al.  Detecting People Carrying Objects Utilizing Lagrangian Dynamics , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.