A Feature Extraction Method Combining Color-Shape for Binocular Stereo Vision Image

Feature extraction is the key and foundation of content-based retrieval of video and image. In order to realize the content-based index and retrieval of binocular stereo vision resources efficiently, the method of feature extraction based on Principal Component Analysis-Histogram of Oriented Depth Gradient (PCA-HODG) and Main Color Histograms (MCH) is proposed. In the method, on the one hand, for the depth map obtained from matching of right image and left image, the PCAHODG algorithm is proposed to extract shape features. In the algorithm, edge detection and gradient calculation in depth map windows are performed to obtain the regional shape histogram features. Moreover, sliding window detection over a depth map is performed to extract the full features. At the same time, in feature extraction of depth map windows and full depth map, principal component analysis is used to realize dimensional reduction respectively. On the other hand, for the left image of binocular stereo vision, the improved MCH algorithm is used to extract color features. Then the shape and color descriptors can be obtained as 2-dimensional factors for similarity calculation. The experimental results show that the proposed method can detect and extract the features of binocular stereo vision image more effectively and achieve similar classification more accurately compared with the existing HOD, RSDF and GIF algorithms. Moreover, the proposed method also has better robustness.

[1]  Quan-Sen Sun,et al.  Geodesic Invariant Feature: A Local Descriptor in Depth , 2015, IEEE Transactions on Image Processing.

[2]  Li-Chen Fu,et al.  Grasping unknown objects using depth gradient feature with eye-in-hand RGB-D sensor , 2014, 2014 IEEE International Conference on Automation Science and Engineering (CASE).

[3]  Xiaojin Gong,et al.  A new depth descriptor for pedestrian detection in RGB-D images , 2012, Proceedings of the 21st International Conference on Pattern Recognition (ICPR2012).

[5]  Ling Guan,et al.  Improving Action Recognition Using Collaborative Representation of Local Depth Map Feature , 2016, IEEE Signal Processing Letters.

[6]  Olga Veksler,et al.  Fast approximate energy minimization via graph cuts , 2001, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[7]  Zhang Guo-xuan An image retrieval algorithm based on HSV color segment histograms , 2009 .

[8]  Neil A. Dodgson,et al.  Real-Time Spatiotemporal Stereo Matching Using the Dual-Cross-Bilateral Grid , 2010, ECCV.

[9]  Tae-Seong Kim,et al.  Depth video-based human activity recognition system using translation and scaling invariant features for life logging at smart home , 2012, IEEE Transactions on Consumer Electronics.

[10]  Kai Oliver Arras,et al.  People detection in RGB-D data , 2011, 2011 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[11]  Cewu Lu,et al.  Range-Sample Depth Feature for Action Recognition , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Giuseppe Valenzise,et al.  Local visual features extraction from texture+depth content based on depth image analysis , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[13]  Hong Liu,et al.  Robust hand tracking with refined CAMShift based on combination of Depth and image features , 2012, 2012 IEEE International Conference on Robotics and Biomimetics (ROBIO).

[14]  Yo-Sung Ho,et al.  Temporally consistent depth map estimation for 3D video generation and coding , 2013, China Communications.

[15]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[16]  Yo-Sung Ho,et al.  Depth map upsampling using depth local features , 2014 .

[17]  Haibo Wang,et al.  Depth-Based Human Fall Detection via Shape Features and Improved Extreme Learning Machine , 2014, IEEE Journal of Biomedical and Health Informatics.

[18]  Lynne E. Parker,et al.  CoDe4D: Color-Depth Local Spatio-Temporal Features for Human Activity Recognition From RGB-D Videos , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[19]  Shuai Yang,et al.  Joint-Feature Guided Depth Map Super-Resolution With Face Priors , 2018, IEEE Transactions on Cybernetics.

[20]  Jue Jiang,et al.  Skin color enhancement based on favorite skin color in HSV color space , 2010, IEEE Transactions on Consumer Electronics.

[21]  Shuicheng Yan,et al.  Body Surface Context: A New Robust Feature for Action Recognition From Depth Videos , 2014, IEEE Transactions on Circuits and Systems for Video Technology.

[22]  Cheng Hong,et al.  RGB-Depth feature for 3D human activity recognition , 2013, China Communications.