Ellipse Detection for Visual Cyclists Analysis "In the Wild"

Autonomous driving safety is becoming a paramount issue due to the emergence of many autonomous vehicle prototypes. The safety measures ensure that autonomous vehicles are safe to operate among pedestrians, cyclists and conventional vehicles. While safety measures for pedestrians have been widely studied in literature, little attention has been paid to safety measures for cyclists. Visual cyclists analysis is a challenging problem due to the complex structure and dynamic nature of the cyclists. The dynamic model used for cyclists analysis heavily relies on the wheels. In this paper, we investigate the problem of ellipse detection for visual cyclists analysis in the wild. Our first contribution is the introduction of a new challenging annotated dataset for bicycle wheels, collected in real-world urban environment. Our second contribution is a method that combines reliable arcs selection and grouping strategies for ellipse detection. The reliable selection and grouping mechanism leads to robust ellipse detections when combined with the standard least square ellipse fitting approach. Our experiments clearly demonstrate that our method provides improved results, both in terms of accuracy and robustness in challenging urban environment settings.

[1]  C.A. Basca,et al.  Randomized Hough Transform for Ellipse Detection with Result Clustering , 2005, EUROCON 2005 - The International Conference on "Computer as a Tool".

[2]  Bin Ran,et al.  Vision-Based Stop Sign Detection and Recognition System for Intelligent Vehicles , 2001 .

[3]  Bao-Chang Pan,et al.  Lip-reading detection and localization based on two stage ellipse fitting , 2008, 2008 International Conference on Wavelet Analysis and Pattern Recognition.

[4]  Michael Goldhammer,et al.  Trajectory prediction of cyclists using a physical model and an artificial neural network , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[5]  Andrew W. Fitzgibbon,et al.  Direct Least Square Fitting of Ellipses , 1999, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  M.K.H. Leung,et al.  Ellipse Detection with Hough Transform in One Dimensional Parametric Space , 2007, 2007 IEEE International Conference on Image Processing.

[7]  K.J. Astrom,et al.  Bicycle dynamics and control: adapted bicycles for education and research , 2005, IEEE Control Systems.

[8]  Erkki Oja,et al.  A new curve detection method: Randomized Hough transform (RHT) , 1990, Pattern Recognit. Lett..

[9]  Daniel Cohen-Or,et al.  Salient geometric features for partial shape matching and similarity , 2006, TOGS.

[10]  Andrew Zisserman,et al.  A Boundary-Fragment-Model for Object Detection , 2006, ECCV.

[11]  Michael Felsberg,et al.  Bicycle tracking using ellipse extraction , 2011, 14th International Conference on Information Fusion.

[12]  Åström,et al.  Bicycle Dynamics and Control , 2000 .

[13]  Siu-Yeung Cho,et al.  Edge curvature and convexity based ellipse detection method , 2012, Pattern Recognit..

[14]  Pakorn Kaewtrakulpong,et al.  Robust Ellipse Detection by Fitting Randomly Selected Edge Patches , 2008 .

[15]  Qiang Ji,et al.  A new efficient ellipse detection method , 2002, Object recognition supported by user interaction for service robots.

[16]  Toshiyuki Gotoh,et al.  An algorithm for model-based stable pupil detection for eye tracking system , 2004, Systems and Computers in Japan.

[17]  John F. Canny,et al.  A Computational Approach to Edge Detection , 1986, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[18]  Bernd Jähne,et al.  BOOK REVIEW: Digital Image Processing, 5th revised and extended edition , 2002 .

[19]  F. Larsson,et al.  Correlating fourier descriptors of local patches for road sign recognition , 2011 .

[20]  Michael Weber,et al.  Real-time detection of elliptic shapes for automated object recognition and object tracking , 2006, Electronic imaging.

[21]  David Gur,et al.  An ellipse-fitting based method for efficient registration of breast masses on two mammographic views. , 2008, Medical physics.

[22]  Hui Xiong,et al.  A new benchmark for vision-based cyclist detection , 2016, 2016 IEEE Intelligent Vehicles Symposium (IV).

[23]  Haibin Ling,et al.  Shape Classification Using the Inner-Distance , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  R. Halír.  Numerically Stable Direct Least Squares Fitting of Ellipses , 1998 .

[25]  Theodosios Pavlidis,et al.  A Shape Analysis Model with Applications to a Character Recognition System , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[26]  Ping Guo,et al.  RANSAC Based Ellipse Detection with Application to Catadioptric Camera Calibration , 2010, ICONIP.

[27]  Robert A. McLaughlin,et al.  Randomized Hough Transform: Improved ellipse detection with comparison , 1998, Pattern Recognit. Lett..

[28]  Jitendra Malik,et al.  Shape matching and object recognition using low distortion correspondences , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[29]  Ross B. Girshick,et al.  Fast R-CNN , 2015, 1504.08083.

[30]  David A. McAllester,et al.  Object Detection with Discriminatively Trained Part Based Models , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Tristrom Cooke.  A Fast Automatic Ellipse Detector , 2010, 2010 International Conference on Digital Image Computing: Techniques and Applications.

[32]  Jitendra Malik,et al.  Recognizing objects in adversarial clutter: breaking a visual CAPTCHA , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[33]  Rita Cucchiara,et al.  A fast and effective ellipse detector for embedded vision applications , 2014, Pattern Recognit..

[34]  Jitendra Malik,et al.  Shape matching and object recognition using shape contexts , 2010, 2010 3rd International Conference on Computer Science and Information Technology.

[35]  G. Griffin,et al.  Caltech-256 Object Category Dataset , 2007 .