Detection of Object Carried Using Spatio-temporal Pattern and Local Directional Pattern Descriptor

A novel method of carried object detection based on silhouette width and spatio-temporal analysis is proposed in this paper. The width vector of silhouette is calculated to characterize the spatial feature and the width image is adopted to preserve the temporal features. The width image which is considered as the texture image represents the walking sequence of pedestrian in a grey-level image. For analyzing the texture features, the local directional pattern code is used to encode the local properties and the local texture pattern descriptor is applied to capture the global characters. Chi-square distance equation is exploited to measure the difference between descriptors. Experimental results show that the width image is an effective and efficient representation, the local directional pattern descriptor is robust and insensitive to noise, and our method is effective. Keywords-carrying object detection; silhouette; the width imag; spatio-temporal analysis; local texture pattern descriptor

[1]  Larry S. Davis,et al.  Learning to Detect Carried Objects with Minimal Supervision , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition Workshops.

[2]  Zhang Jia-shu Noise-robust face recognition algorithm based on improved local directional pattern , 2012 .

[3]  Han Su,et al.  A new method of gait recognition independent of view angle , 2010, 2010 International Conference on Machine Learning and Cybernetics.

[4]  Dima Damen,et al.  Detecting Carried Objects from Sequences of Walking Pedestrians , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Larry S. Davis,et al.  Real-time foreground-background segmentation using codebook model , 2005, Real Time Imaging.

[6]  Oksam Chae,et al.  Facial expression recognition using Local Directional Pattern (LDP) , 2010, 2010 IEEE International Conference on Image Processing.

[7]  Larry S. Davis,et al.  Detection of people carrying objects : a motion-based recognition approach , 2002, Proceedings of Fifth IEEE International Conference on Automatic Face Gesture Recognition.

[8]  F BobickAaron,et al.  The Recognition of Human Movement Using Temporal Templates , 2001 .

[9]  Zhang Fang-sheng,et al.  The Face Recognition Algorithm Based on Improved LBP , 2012 .

[10]  Larry S. Davis,et al.  Hydra: multiple people detection and tracking using silhouettes , 1999, Proceedings 10th International Conference on Image Analysis and Processing.

[11]  Anthony G. Cohn,et al.  Carried Object Detection and Tracking Using Geometric Shape Models and Spatio-temporal Consistency , 2013, ICVS.

[12]  Oksam Chae,et al.  Local directional pattern variance (ldpv): a robust feature descriptor for facial expression recognition , 2012, Int. Arab J. Inf. Technol..

[13]  Rémi Ronfard,et al.  Free viewpoint action recognition using motion history volumes , 2006, Comput. Vis. Image Underst..

[14]  James W. Davis,et al.  The Recognition of Human Movement Using Temporal Templates , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[15]  Bo Yuan,et al.  Carried object detection in short video sequences , 2014, 2014 12th International Conference on Signal Processing (ICSP).

[16]  Shin'ichi Satoh,et al.  Carried object detection using star skeleton with adaptive centroid and time series graph , 2010, IEEE 10th INTERNATIONAL CONFERENCE ON SIGNAL PROCESSING PROCEEDINGS.

[17]  Kuo-Chin Fan,et al.  Carried Object Detection Using Ratio Histogram and its Application to Suspicious Event Analysis , 2009, IEEE Transactions on Circuits and Systems for Video Technology.

[18]  Xuelong Li,et al.  Human Carrying Status in Visual Surveillance , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[19]  Oksam Chae,et al.  Gender Classification Using Local Directional Pattern (LDP) , 2010, 2010 20th International Conference on Pattern Recognition.

[20]  Bir Bhanu,et al.  Individual recognition using gait energy image , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[21]  Tobias Senst,et al.  Detecting People Carrying Objects Utilizing Lagrangian Dynamics , 2012, 2012 IEEE Ninth International Conference on Advanced Video and Signal-Based Surveillance.

[22]  Yue Qi,et al.  Carrying object detection and tracking based on body main axis , 2007, 2007 International Conference on Wavelet Analysis and Pattern Recognition.

[23]  Ahmed M. Elgammal,et al.  Carrying Object Detection Using Pose Preserving Dynamic Shape Models , 2006, AMDO.

[24]  Giovanni Attolico,et al.  Detection of objects carried by people , 2002, Proceedings. International Conference on Image Processing.

[25]  Rubén Heras Evangelio,et al.  Towards Detecting People Carrying Objects - A Periodicity Dependency Pattern Approach , 2010, VISAPP.

[26]  Rubén Heras Evangelio,et al.  Detecting people carrying objects based on an optical flow motion model , 2011, 2011 IEEE Workshop on Applications of Computer Vision (WACV).

[27]  Oksam Chae,et al.  Local Directional Pattern (LDP) – A Robust Image Descriptor for Object Recognition , 2010, 2010 7th IEEE International Conference on Advanced Video and Signal Based Surveillance.

[28]  Larry S. Davis,et al.  W4: Real-Time Surveillance of People and Their Activities , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[29]  Rocío González-Díaz,et al.  Gait-Based Carried Object Detection Using Persistent Homology , 2014, CIARP.

[30]  Oksam Chae,et al.  Local Directional Texture Pattern image descriptor , 2015, Pattern Recognit. Lett..