Template Matching via Densities on the Roto-Translation Group

We propose a template matching method for the detection of 2D image objects that are characterized by orientation patterns. Our method is based on data representations via orientation scores, which are functions on the space of positions and orientations, and which are obtained via a wavelet-type transform. This new representation allows us to detect orientation patterns in an intuitive and direct way, namely via cross-correlations. Additionally, we propose a generalized linear regression framework for the construction of suitable templates using smoothing splines. Here, it is important to recognize a curved geometry on the position-orientation domain, which we identify with the Lie group SE(2): the roto-translation group. Templates are then optimized in a B-spline basis, and smoothness is defined with respect to the curved geometry. We achieve state-of-the-art results on three different applications: detection of the optic nerve head in the retina (99.83 percent success rate on 1,737 images), of the fovea in the retina (99.32 percent success rate on 1,616 images), and of the pupil in regular camera images (95.86 percent on 1,521 images). The high performance is due to inclusion of both intensity and orientation features with effective geometric priors in the template matching. Moreover, our method is fast due to a cross-correlation based matching approach.

[1]  L. Hörmander Hypoelliptic second order differential equations , 1967 .

[2]  C. R. Deboor,et al.  A practical guide to splines , 1978 .

[3]  Peter Craven,et al.  Smoothing noisy data with spline functions , 1978 .

[4]  Ieee Xplore,et al.  IEEE Transactions on Pattern Analysis and Machine Intelligence Information for Authors , 2022, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  M. Hutchinson,et al.  Smoothing noisy data with spline functions , 1985 .

[6]  B. Yandell,et al.  Automatic Smoothing of Regression Functions in Generalized Linear Models , 1986 .

[7]  Edward H. Adelson,et al.  The Design and Use of Steerable Filters , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Chong Gu,et al.  Cross-Validating Non-Gaussian Data , 1992 .

[9]  Michael Unser,et al.  B-spline signal processing. I. Theory , 1993, IEEE Trans. Signal Process..

[10]  Akram Aldroubi,et al.  B-SPLINE SIGNAL PROCESSING: PART I-THEORY , 1993 .

[11]  B. Silverman,et al.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[12]  B. Silverman,et al.  Nonparametric Regression and Generalized Linear Models: A roughness penalty approach , 1993 .

[13]  K. Yosida Resolvent and Spectrum , 1995 .

[14]  G. Wahba,et al.  A GENERALIZED APPROXIMATE CROSS VALIDATION FOR SMOOTHING SPLINES WITH NON-GAUSSIAN DATA , 1996 .

[15]  Michael Unser,et al.  Splines: a perfect fit for signal and image processing , 1999, IEEE Signal Process. Mag..

[16]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[17]  Arthur E. Hoerl,et al.  Ridge Regression: Biased Estimation for Nonorthogonal Problems , 2000, Technometrics.

[18]  Paul A. Viola,et al.  Rapid object detection using a boosted cascade of simple features , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[19]  Elton P. Hsu Stochastic analysis on manifolds , 2002 .

[20]  Enrico Grisan,et al.  Luminosity and contrast normalization in retinal images , 2005, Medical Image Anal..

[21]  Giovanna Citti,et al.  A Cortical Based Model of Perceptual Completion in the Roto-Translation Space , 2006, Journal of Mathematical Imaging and Vision.

[22]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  S. Shankar Sastry,et al.  Generalized principal component analysis (GPCA) , 2005, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  I. Deary,et al.  Retinal image analysis: Concepts, applications and potential , 2006, Progress in Retinal and Eye Research.

[25]  Michael Felsberg,et al.  Image Analysis and Reconstruction using a Wavelet Transform Constructed from a Reducible Representation of the Euclidean Motion Group , 2007, International Journal of Computer Vision.

[26]  Xavier Pennec,et al.  Intrinsic Statistics on Riemannian Manifolds: Basic Tools for Geometric Measurements , 2006, Journal of Mathematical Imaging and Vision.

[27]  Bernhard Burgeth,et al.  Scale Spaces on Lie Groups , 2007, SSVM.

[28]  B. H. Romeny,et al.  Invertible Orientation Scores as an Application of Generalized Wavelet Theory , 2007, Pattern Recognition and Image Analysis.

[29]  Aliaa A. A. Youssif,et al.  Optic Disc Detection From Normalized Digital Fundus Images by Means of a Vessels' Direction Matched Filter , 2008, IEEE Transactions on Medical Imaging.

[30]  Hongzhe Li,et al.  In Response to Comment on "Network-constrained regularization and variable selection for analysis of genomic data" , 2008, Bioinform..

[31]  Fatih Murat Porikli,et al.  Learning on lie groups for invariant detection and tracking , 2008, 2008 IEEE Conference on Computer Vision and Pattern Recognition.

[32]  Alan Hanjalic,et al.  Eye localization for face matching: is it always useful and under what conditions? , 2008, CIVR '08.

[33]  Diego Marin,et al.  Automated Optic Disc Detection in Retinal Images of Patients with Diabetic Retinopathy and Risk of Macular Edema , 2009 .

[34]  Shie Mannor,et al.  Robustness and Regularization of Support Vector Machines , 2008, J. Mach. Learn. Res..

[35]  Ioannis Pitas,et al.  Facial feature detection using distance vector fields , 2009, Pattern Recognit..

[36]  Christopher Hunt,et al.  Notes on the OpenSURF Library , 2009 .

[37]  Bram van Ginneken,et al.  Fast detection of the optic disc and fovea in color fundus photographs , 2009, Medical Image Anal..

[38]  Paola Campadelli,et al.  Precise Eye and Mouth Localization , 2009, Int. J. Pattern Recognit. Artif. Intell..

[39]  Qiang Ji,et al.  In the Eye of the Beholder: A Survey of Models for Eyes and Gaze , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Mads Nielsen,et al.  A framework for optimizing measurement weight maps to minimize the required sample size , 2010, Medical Image Anal..

[41]  Manuel Emilio Gegúndez-Arias,et al.  Detecting the Optic Disc Boundary in Digital Fundus Images Using Morphological, Edge Detection, and Feature Extraction Techniques , 2010, IEEE Transactions on Medical Imaging.

[42]  J. P. Lewis Fast Normalized Cross-Correlation , 2010 .

[43]  R. Duits,et al.  Left-invariant parabolic evolutions on SE(2) and contour enhancement via invertible orientation scores. Part I: Linear left-invariant diffusion equations on SE(2) , 2010 .

[44]  Ashutosh Kumar Singh,et al.  The Elements of Statistical Learning: Data Mining, Inference, and Prediction , 2010 .

[45]  Marios S. Pattichis,et al.  Fast localization of optic disc and fovea in retinal images for eye disease screening , 2011, Medical Imaging.

[46]  S. Geer,et al.  The Smooth-Lasso and other ℓ1+ℓ2-penalized methods , 2011 .

[47]  Shijian Lu,et al.  Accurate and Efficient Optic Disc Detection and Segmentation by a Circular Transformation , 2011, IEEE Transactions on Medical Imaging.

[48]  Pan Yu,et al.  Automated localization of retinal features. , 2011, Applied optics.

[49]  Erhardt Barth,et al.  Accurate Eye Centre Localisation by Means of Gradients , 2011, VISAPP.

[50]  Shijian Lu,et al.  Automatic Optic Disc Detection From Retinal Images by a Line Operator , 2011, IEEE Transactions on Biomedical Engineering.

[51]  P. Thomas Fletcher,et al.  Geodesic Regression and the Theory of Least Squares on Riemannian Manifolds , 2012, International Journal of Computer Vision.

[52]  Theo Gevers,et al.  Accurate Eye Center Location through Invariant Isocentric Patterns , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[53]  Marios S. Pattichis,et al.  Fast Localization and Segmentation of Optic Disk in Retinal Images Using Directional Matched Filtering and Level Sets , 2012, IEEE Transactions on Information Technology in Biomedicine.

[54]  Stéphane Mallat,et al.  Invariant Scattering Convolution Networks , 2012, IEEE transactions on pattern analysis and machine intelligence.

[55]  Marie Chupin,et al.  Spatial and Anatomical Regularization of SVM: A General Framework for Neuroimaging Data , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[56]  Remco Duits,et al.  A Multi-Orientation Analysis Approach to Retinal Vessel Tracking , 2012, Journal of Mathematical Imaging and Vision.

[57]  Andrea Giachetti,et al.  The use of radial symmetry to localize retinal landmarks , 2013, Comput. Medical Imaging Graph..

[58]  José Manuel Bravo,et al.  Locating the fovea center position in digital fundus images using thresholding and feature extraction techniques , 2013, Comput. Medical Imaging Graph..

[59]  Igor S. Pandzic,et al.  Eye pupil localization with an ensemble of randomized trees , 2014, Pattern Recognit..

[60]  Remco Duits,et al.  Numerical Approaches for Linear Left-invariant Diffusions on SE(2), their Comparison to Exact Solutions, and their Applications in Retinal Imaging , 2014, Numerical Mathematics: Theory, Methods and Applications.

[61]  Remco Duits,et al.  Training of Templates for Object Recognition in Invertible Orientation Scores: Application to Optic Nerve Head Detection in Retinal Images , 2015, EMMCVPR.

[62]  Arturo Aquino,et al.  Establishing the macular grading grid by means of fovea centre detection using anatomical-based and visual-based features , 2014, Comput. Biol. Medicine.

[63]  C. Distante,et al.  Unsupervised Eye Pupil Localization through Differential Geometry and Local Self-Similarity Matching , 2014, PloS one.

[64]  R. Venkatesh Babu,et al.  Approximate Nearest Neighbour Field based Optic Disk Detection , 2014, Comput. Medical Imaging Graph..

[65]  Remco Duits,et al.  Optic Nerve Head Detection via Group Correlations in Multi-orientation Transforms , 2014, ICIAR.

[66]  Xavier Pennec,et al.  A Survey of Mathematical Structures for Extending 2D Neurogeometry to 3D Image Processing , 2015, MCV@MICCAI.

[67]  José Manuel Bravo,et al.  Obtaining optic disc center and pixel region by automatic thresholding methods on morphologically processed fundus images , 2015, Comput. Methods Programs Biomed..

[68]  Ana Maria Mendonça,et al.  Optic disc segmentation using the sliding band filter , 2015, Comput. Biol. Medicine.

[69]  M. Abràmoff,et al.  Mass Screening of Diabetic Retinopathy Using Automated Methods , 2015 .