Human detection in fish-eye images using HOG-based detectors over rotated windows

Fish-eye cameras are efficient means to provide an omni-view video recording over a large area using a single camera. Although effective algorithms for human detection in images captured by conventional cameras have been developed, human detection in fish-eye images remains an open challenge. Recognizing that humans typically appear on radial lines emitted from the center in fish-eye images, we propose to apply the popular human detection algorithm based on the Histogram of Oriented Gradient (HOG) features after rotating each search window on a radial line to the vertical reference line. We extract positive and negative examples by such rotations to train the SVM classifier using HOG features. To detect humans in a given image, we rotate the image successively and detect windows containing humans along the reference line after each rotation using the trained classifier. We use multiple window sizes to detect people with different appearance sizes. We further develop an algorithm to discover multiple overlapping windows covering the same person and identify the window that encloses the person the best. The proposed method has yielded highly accurate human detection in low-resolution, low-contrast images containing multiple people with varying poses and sizes.

[1]  Rainer Lienhart,et al.  An extended set of Haar-like features for rapid object detection , 2002, Proceedings. International Conference on Image Processing.

[2]  Masafumi Hashimoto,et al.  People detection and tracking from fish-eye image based on probabilistic appearance model , 2011, SICE Annual Conference 2011.

[3]  Thorsten Joachims,et al.  Making large scale SVM learning practical , 1998 .

[4]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[5]  Pietro Perona,et al.  Pedestrian Detection: An Evaluation of the State of the Art , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  J. Yamaguchi,et al.  Human tracking using fisheye images , 2007, SICE Annual Conference 2007.

[7]  Huai Yuan,et al.  Moving Object Detection Using an In-Vehicle Fish-Eye Camera , 2010, 2010 6th International Conference on Wireless Communications Networking and Mobile Computing (WiCOM).

[8]  Tomaso A. Poggio,et al.  Pedestrian detection using wavelet templates , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.