A Partial Intensity Invariant Feature Descriptor for Multimodal Retinal Image Registration

Detection of vascular bifurcations is a challenging task in multimodal retinal image registration. Existing algorithms based on bifurcations usually fail in correctly aligning poor quality retinal image pairs. To solve this problem, we propose a novel highly distinctive local feature descriptor named partial intensity invariant feature descriptor (PIIFD) and describe a robust automatic retinal image registration framework named Harris-PIIFD. PIIFD is invariant to image rotation, partially invariant to image intensity, affine transformation, and viewpoint/perspective change. Our Harris-PIIFD framework consists of four steps. First, corner points are used as control point candidates instead of bifurcations since corner points are sufficient and uniformly distributed across the image domain. Second, PIIFDs are extracted for all corner points, and a bilateral matching technique is applied to identify corresponding PIIFDs matches between image pairs. Third, incorrect matches are removed and inaccurate matches are refined. Finally, an adaptive transformation is used to register the image pairs. PIIFD is so distinctive that it can be correctly identified even in nonvascular areas. When tested on 168 pairs of multimodal retinal images, the Harris-PIIFD far outperforms existing algorithms in terms of robustness, accuracy, and computational efficiency.

[1]  Matthijs C. Dorst.  Distinctive Image Features from Scale-Invariant Keypoints , 2011 .

[2]  Chia-Ling Tsai,et al.  The Edge-Driven Dual-Bootstrap Iterative Closest Point Algorithm for Registration of Multimodal Fluorescein Angiogram Sequence , 2010, IEEE Transactions on Medical Imaging.

[3]  R. T. Smith,et al.  A novel registration method for retinal images based on local features , 2008, 2008 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[4]  Chia-Ling Tsai,et al.  Registration of Challenging Image Pairs: Initialization, Estimation, and Decision , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[5]  Jeff Orchard.  Efficient Least Squares Multimodal Registration With a Globally Exhaustive Alignment Search , 2007, IEEE Transactions on Image Processing.

[6]  Philippe C. Cattin,et al.  Retina Mosaicing Using Local Features , 2006, MICCAI.

[7]  Luc Van Gool,et al.  SURF: Speeded Up Robust Features , 2006, ECCV.

[8]  Guoliang Fan,et al.  Hybrid retinal image registration , 2006, IEEE Transactions on Information Technology in Biomedicine.

[9]  Cordelia Schmid,et al.  A Performance Evaluation of Local Descriptors , 2005, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Conor Heneghan,et al.  Registration of digital retinal images using landmark correspondence by expectation maximization , 2004, Image Vis. Comput..

[11]  Jacek M. Zurada,et al.  An approach to multimodal biomedical image registration utilizing particle swarm optimization , 2004, IEEE Transactions on Evolutionary Computation.

[12]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[13]  D. Hill,et al.  Non-rigid image registration: theory and practice. , 2004, The British journal of radiology.

[14]  Chia-Ling Tsai,et al.  The dual-bootstrap iterative closest point algorithm with application to retinal image registration , 2003, IEEE Transactions on Medical Imaging.

[15]  Jan Flusser,et al.  Image registration methods: a survey , 2003, Image Vis. Comput..

[16]  Max A. Viergever,et al.  Mutual-information-based registration of medical images: a survey , 2003, IEEE Transactions on Medical Imaging.

[17]  Yulong Shen,et al.  Registration and fusion of retinal images-an evaluation study , 2003, IEEE Transactions on Medical Imaging.

[18]  Hong Shen,et al.  Frame-Rate Spatial Referencing Based on Invariant Indexing and Alignment with Application to Online Retinal Image Registration , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Conor Heneghan,et al.  Retinal image registration using control points , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[20]  Chia-Ling Tsai,et al.  Covariance-driven retinal image registration initialized from small sets of landmark correspondences , 2002, Proceedings IEEE International Symposium on Biomedical Imaging.

[21]  Yan Zhang,et al.  Automatic retinal image registration based on blood vessels feature point , 2002, Proceedings. International Conference on Machine Learning and Cybernetics.

[22]  Jiri Jan,et al.  Registration of multimodal images of retina , 2002, Proceedings of the Second Joint 24th Annual Conference and the Annual Fall Meeting of the Biomedical Engineering Society] [Engineering in Medicine and Biology.

[23]  Sabih H. Gerez,et al.  Systematic Methods for the Computation of the Directional Fields and Singular Points of Fingerprints , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[24]  Charles V. Stewart,et al.  A Feature-Based, Robust, Hierarchical Algorithm for Registering Pairs of Images of the Curved Human Retina , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[25]  L. Zangwill,et al.  Using optical imaging summary data to detect glaucoma. , 2001, Ophthalmology.

[26]  James J. Little,et al.  Vision-based mobile robot localization and mapping using scale-invariant features , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[27]  D. Hill,et al.  Medical image registration , 2001, Physics in medicine and biology.

[28]  Michael Unser,et al.  Optimization of mutual information for multiresolution image registration , 2000, IEEE Trans. Image Process..

[29]  Joan Serrat,et al.  Retinal image registration using creases as anatomical landmarks , 2000, Proceedings 15th International Conference on Pattern Recognition. ICPR-2000.

[30]  Ole Vilhelm Larsen,et al.  Automatic registration of ocular fundus images , 2000 .

[31]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[32]  Robyn A. Owens,et al.  Registration of stereo and temporal images of the retina , 1999, IEEE Transactions on Medical Imaging.

[33]  Konstantina S. Nikita,et al.  Automatic retinal image registration scheme using global optimization techniques , 1999, IEEE Transactions on Information Technology in Biomedicine.

[34]  Simon R. Arridge,et al.  A survey of hierarchical non-linear medical image registration , 1999, Pattern Recognit..

[35]  Konstantina S. Nikita,et al.  Automatic retinal registration using global optimization techniques , 1998, Proceedings of the 20th Annual International Conference of the IEEE Engineering in Medicine and Biology Society. Vol.20 Biomedical Engineering Towards the Year 2000 and Beyond (Cat. No.98CH36286).

[36]  Paul D. Gader,et al.  Hough-based registration of retinal images , 1998, SMC'98 Conference Proceedings. 1998 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.98CH36218).

[37]  Anil K. Jain,et al.  Fingerprint Image Enhancement: Algorithm and Performance Evaluation , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[38]  Max A. Viergever,et al.  A survey of medical image registration , 1998, Medical Image Anal..

[39]  A. Pinz,et al.  Mapping the human retina , 1996, IEEE Transactions on Medical Imaging.

[40]  B. Roysam,et al.  Image processing algorithms for retinal montage synthesis, mapping, and real-time location determination , 1998, IEEE Transactions on Biomedical Engineering.

[41]  Lucia Ballerini.  Temporal matched filters for integration of ocular fundus images , 1997, Proceedings of 13th International Conference on Digital Signal Processing.

[42]  David G. Lowe,et al.  Shape indexing using approximate nearest-neighbour search in high-dimensional spaces , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[43]  Guy Marchal,et al.  Multimodality image registration by maximization of mutual information , 1997, IEEE Transactions on Medical Imaging.

[44]  P. Saine,et al.  Ophthalmic Photography: A Textbook of Retinal Photography, Angiography, and Electronic Imaging , 1996 .

[45]  B L Trus,et al.  Constructing retinal fundus photomontages. A new computer-based method. , 1996, Investigative ophthalmology & visual science.

[46]  A. V. Cideciyan,et al.  Registration of ocular fundus images: an algorithm using cross-correlation of triple invariant image descriptors , 1995 .

[47]  A.M. Mendonca,et al.  A new similarity criterion for retinal image registration , 1994, Proceedings of 1st International Conference on Image Processing.

[48]  Michael H. Goldbaum,et al.  Registering retinal images using automatically selected control point pairs , 1994, Proceedings of 1st International Conference on Image Processing.

[49]  Liang Zhou,et al.  The detection and quantification of retinopathy using digital angiograms , 1994, IEEE Trans. Medical Imaging.

[50]  Piotr Jasiobedzki.  Registration of retinal images using adaptive adjacency graphs , 1993, [1993] Computer-Based Medical Systems-Proceedings of the Sixth Annual IEEE Symposium.

[51]  Lisa M. Brown,et al.  A survey of image registration techniques , 1992, CSUR.

[52]  Fundus photographic risk factors for progression of diabetic retinopathy. ETDRS report number 12. Early Treatment Diabetic Retinopathy Study Research Group. , 1991, Ophthalmology.

[53]  K Taylor,et al.  Automatic geometrical registration of fluorescein retinal angiograms. , 1990, Computers and biomedical research, an international journal.

[54]  Joseph Jy-Haw Yu,et al.  Fast algorithm for digital retinal image alignment , 1989, Images of the Twenty-First Century. Proceedings of the Annual International Engineering in Medicine and Biology Society,.

[55]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[56]  G. Timberlake,et al.  Feature-Based Registration of Retinal Images , 1987, IEEE Transactions on Medical Imaging.

[57]  S. Nussey,et al.  Accurate registration of paired macular and nasal digital retinal images : a potential aid to diabetic retinopathy screening , 2022 .