A direct approach for object detection with catadioptric omnidirectional cameras

In this paper, we present an omnidirectional vision-based method for object detection. We first adopt the conventional camera approach that uses sliding windows and histogram of oriented gradients (HOG) features. Then, we describe how the feature extraction step of the conventional approach should be modified for a theoretically correct and effective use in omnidirectional cameras. Main steps are modification of gradient magnitudes using Riemannian metric and conversion of gradient orientations to form an omnidirectional sliding window. In this way, we perform object detection directly on the omnidirectional images without converting them to panoramic or perspective images. Our experiments, with synthetic and real images, compare the proposed approach with regular (unmodified) HOG computation on both omnidirectional and panoramic images. Results show that the proposed approach should be preferred.

[1]  João Pedro Barreto,et al.  sRD-SIFT: Keypoint Detection and Matching in Images With Radial Distortion , 2012, IEEE Transactions on Robotics.

[2]  Luis Puig,et al.  Scale Space for Camera Invariant Features , 2014, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[4]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Peter I. Corke,et al.  Scale-Invariant Features on the Sphere , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[6]  Luis Puig,et al.  Scale space for central catadioptric systems: Towards a generic camera feature extractor , 2011, 2011 International Conference on Computer Vision.

[7]  Yohan Dupuis,et al.  Fusion of Omnidirectional and PTZ Cameras for Face Detection and Tracking , 2010, 2010 International Conference on Emerging Security Technologies.

[8]  B. Schiele,et al.  Combined Object Categorization and Segmentation With an Implicit Shape Model , 2004 .

[9]  Subhransu Maji,et al.  Classification using intersection kernel support vector machines is efficient , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[10]  Kostas Daniilidis,et al.  A Unifying Theory for Central Panoramic Systems and Practical Applications , 2000, ECCV.

[11]  Patrick Rives,et al.  Single View Point Omnidirectional Camera Calibration from Planar Grids , 2007, Proceedings 2007 IEEE International Conference on Robotics and Automation.

[12]  Yalin Bastanlar,et al.  A Direct approach for human detection with catadioptric omnidirectional cameras , 2014, 2014 22nd Signal Processing and Communications Applications Conference (SIU).

[13]  A. Makadia,et al.  Image processing in catadioptric planes: spatiotemporal derivatives and optical flow computation , 2002, Proceedings of the IEEE Workshop on Omnidirectional Vision 2002. Held in conjunction with ECCV'02.

[14]  Pascal Frossard,et al.  OmniSIFT: Scale invariant features in omnidirectional images , 2010, 2010 IEEE International Conference on Image Processing.

[15]  Xavier Bresson,et al.  Scale Space Analysis and Active Contours for Omnidirectional Images , 2007, IEEE Transactions on Image Processing.

[16]  David A. McAllester,et al.  A discriminatively trained, multiscale, deformable part model , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[17]  Hyun-Ki Hong,et al.  People detection method using graphics processing units for a mobile robot with an omnidirectional camera , 2011 .

[18]  Dan Roth,et al.  Learning a Sparse Representation for Object Detection , 2002, ECCV.

[19]  Bernt Schiele,et al.  New features and insights for pedestrian detection , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[20]  Yazhe Tang,et al.  A rotating adaptive model for human tracking in Thermal Catadioptric Omnidirectional Vision , 2011, 2011 IEEE International Conference on Robotics and Biomimetics.

[21]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[22]  Zhongwei Li,et al.  Human tracking in thermal catadioptric omnidirectional vision , 2011, 2011 IEEE International Conference on Information and Automation.

[23]  T. Bulow.  Spherical diffusion for 3D surface smoothing , 2002, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Ming-Liang Wang,et al.  Object recognition from omnidirectional visual sensing for mobile robot applications , 2009, 2009 IEEE International Conference on Systems, Man and Cybernetics.

[25]  Luis Puig,et al.  Calibration of Central Catadioptric Cameras Using a DLT-Like Approach , 2011, International Journal of Computer Vision.