Neural Image Thresholding Using SIFT: A Comparative Study

The task of image thresholding mainly classifies the image data into two regions, a necessary step in many image analysis and recognition applications. Different images, however, possess different characteristics making the thresholding by one single algorithm very difficult if not impossible. Hence, to optimally binarize a single image, one must usually try more than one threshold in order to obtain maximum segmentation accuracy. This approach could be very complex and time-consuming especially when a large number of images should be segmented in real time. Generally the challenge arises because any thresholding method may perform well for a certain image class but not for all images. In this paper, a supervised neural network is used to “dynamically” threshold images by learning the suitable threshold for each image type. The thresholds generated by the neural network can be used to binarize the images in two different ways. In the first approach, the scale-invariant feature transform (SIFT) method is used to assign a number of key points to the whole image. In the second approach,the SIFT is used to assign a number of key points within a rectangle around the region of interest. The results of each test are compared with the Otsu algorithm, active shape models (ASM), and level sets technique (LS). The neural network is trained using a set of features extracted from medical images randomly selected form a sample set and then tested using the remaining images. This process is repeated multiple times to verify the generalization ability of the network. The average of segmentation accuracy is calculated by comparing every segmented image with corresponding gold standard images.

[1]  Jun Zhang,et al.  Image Segmentation Based on 2D Otsu Method with Histogram Analysis , 2008, 2008 International Conference on Computer Science and Software Engineering.

[2]  Ghassan Hamarneh,et al.  Review Active Shape Models - Part II: Image Search and Classification , 1998 .

[3]  Gang Wang,et al.  A Fast 2D Otsu Thresholding Algorithm Based on Improved Histogram , 2009, 2009 Chinese Conference on Pattern Recognition.

[4]  Xianglong Tang,et al.  Probability density difference-based active contour for ultrasound image segmentation , 2010, Pattern Recognit..

[5]  Yo-Sung Ho,et al.  3-D Active Shape Image Segmentation Using a Scale Model , 2006, 2006 IEEE International Symposium on Signal Processing and Information Technology.

[6]  Rae-Hong Park,et al.  Self-Calibration with Two Views Using the Scale-Invariant Feature Transform , 2006, ISVC.

[7]  Yingming Hao,et al.  Integral Image Based Fast Algorithm for Two-Dimensional Otsu Thresholding , 2008, 2008 Congress on Image and Signal Processing.

[8]  N. Otsu A threshold selection method from gray level histograms , 1979 .

[9]  Suchendra M. Bhandarkar,et al.  A hierarchical neural network and its application to image segmentation , 1996 .

[10]  Aaron Fenster,et al.  Prostate boundary segmentation from ultrasound images using 2D active shape models: Optimisation and extension to 3D , 2006, Comput. Methods Programs Biomed..

[11]  Chuan-Yu Chang,et al.  Medical image segmentation using a contextual-constraint-based Hopfield neural cube , 2001, Image Vis. Comput..

[12]  Ghassan Hamarneh,et al.  Review - Active Shape Models - Part I: Modeling Shape and Gray Level Variation , 1998 .

[13]  Chunming Li,et al.  Level set evolution without re-initialization: a new variational formulation , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[14]  C. Taylor,et al.  Active shape models - 'Smart Snakes'. , 1992 .

[15]  L.-K. Shark,et al.  Medical Image Segmentation Using New Hybrid Level-Set Method , 2008, 2008 Fifth International Conference BioMedical Visualization: Information Visualization in Medical and Biomedical Informatics.

[16]  Aly A. Farag,et al.  Two-stage neural network for volume segmentation of medical images , 1997, Pattern Recognit. Lett..

[17]  Eam Khwang Teoh,et al.  Robust MR Image Segmentation Using 3D Partitioned Active Shape Models , 2006, 2006 9th International Conference on Control, Automation, Robotics and Vision.

[18]  Miguel Arias-Estrada,et al.  Iterative Closest SIFT Formulation for Robust Feature Matching , 2006, ISVC.

[19]  Jian Yu,et al.  Otsu Method and K-means , 2009, 2009 Ninth International Conference on Hybrid Intelligent Systems.

[20]  Guillermo Sapiro,et al.  Geodesic Active Contours , 1995, International Journal of Computer Vision.

[21]  J. Sethian,et al.  Fronts propagating with curvature-dependent speed: algorithms based on Hamilton-Jacobi formulations , 1988 .

[22]  Andrea Lagorio,et al.  On the Use of SIFT Features for Face Authentication , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[23]  David G. Lowe,et al.  Object recognition from local scale-invariant features , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[24]  Sun Fengjie,et al.  2D Otsu Segmentation Algorithm Based on Simulated Annealing Genetic Algorithm for Iced-Cable Images , 2009, 2009 International Forum on Information Technology and Applications.

[25]  Maw-Kae Hor,et al.  Modified sift descriptor for image matching under interference , 2008, ICMLC 2008.

[26]  Jorge Núñez,et al.  Astronomical image segmentation by self-organizing neural networks and wavelets , 2003, Neural Networks.

[27]  Bülent Sankur,et al.  Survey over image thresholding techniques and quantitative performance evaluation , 2004, J. Electronic Imaging.

[28]  Bülent Sankur,et al.  Image segmentation by relaxation using constraint satisfaction neural network , 2002, Image Vis. Comput..

[29]  Tony Lindeberg,et al.  Feature Detection with Automatic Scale Selection , 1998, International Journal of Computer Vision.

[30]  Tamer Ölmez,et al.  An incremental neural network for tissue segmentation in ultrasound images , 2007, Comput. Methods Programs Biomed..

[31]  Timothy F. Cootes,et al.  Use of active shape models for locating structures in medical images , 1994, Image Vis. Comput..