Comparative analysis and classification of features for image models

This study has been conducted in the framework of developing one of the directions of descriptive approach to image analysis and recognition, and it is devoted to one of the main tools of this approach, namely, the use of formal image models in solving recognition problems. We systematized the image features widely used in solving applied problems of image analysis and recognition. It is well known that the mathematical nature and functional meaning of these features, as well as computational and measurement methods employed, are extremely various. The main results are the following: different approaches to the classification of image features are introduced, comparative analysis of them is performed, and the aspect of descriptivity is realized by numerous examples of the considered classifications being filled in by features (descriptors). On the basis of these results, certain recommendations and criteria for choosing the features in applied problems of image analysis and recognition are derived. The considered classifications of image features enable the construction of multiple-aspect image representations that preserve information essential to an applied problem. As a tool for choosing the features that depend on specific characteristics of a given problem and the initial data, we propose using parametrical generating descriptive trees, which support the creation and use of multiple-aspect image representation on the basis of different classifications of image features.

[1]  Franz L. Alt,et al.  Digital Pattern Recognition by Moments , 1962, JACM.

[2]  Ming-Kuei Hu,et al.  Visual pattern recognition by moment invariants , 1962, IRE Trans. Inf. Theory.

[3]  Martin D. Levine,et al.  Feature extraction: A survey , 1969 .

[4]  George Nagy,et al.  Feature Extraction on Binary Patterns , 1969, IEEE Trans. Syst. Sci. Cybern..

[5]  F.W. Smith,et al.  Automatic Ship Photo Interpretation by the Method of Moments , 1971, IEEE Transactions on Computers.

[6]  Theodosios Pavlidis,et al.  Segmentation of pictures and maps through functional approximation , 1972, Comput. Graph. Image Process..

[7]  Ralph Roskies,et al.  Fourier Descriptors for Plane Closed Curves , 1972, IEEE Transactions on Computers.

[8]  Robert M. Haralick,et al.  Textural Features for Image Classification , 1973, IEEE Trans. Syst. Man Cybern..

[9]  Hooshang Hemami,et al.  Identification of Three-Dimensional Objects Using Fourier Descriptors of the Boundary Curve , 1974, IEEE Trans. Syst. Man Cybern..

[10]  M. Braunstein Depth perception through motion , 1976 .

[11]  Azriel Rosenfeld,et al.  Digital Picture Processing , 1976 .

[12]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[13]  King-Sun Fu,et al.  Shape Discrimination Using Fourier Descriptors , 1977, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[14]  Benoit B. Mandelbrot,et al.  Fractal Geometry of Nature , 1984 .

[15]  T. Pavlidis,et al.  A graph-theoretic approach to picture processing , 1978 .

[16]  R. Wong,et al.  Scene matching with invariant moments , 1978 .

[17]  Theo Pavlidis,et al.  Filling algorithms for raster graphics , 1979 .

[18]  Claude L. Fennema,et al.  Velocity determination in scenes containing several moving objects , 1979 .

[19]  Patrick C. Chen,et al.  Segmentation by texture using a co-occurrence matrix and a split-and-merge algorithm☆ , 1979 .

[20]  Jake K. Aggarwal,et al.  Segmentation through the detection of changes due to motion , 1979 .

[21]  C. Dyer Computing the Euler number of an image from its quadtree , 1980 .

[22]  P. Wintz,et al.  An efficient three-dimensional aircraft recognition algorithm using normalized fourier descriptors , 1980 .

[23]  M. Yachida,et al.  A plan-guided analysis of cineangiograms for measurement of dynamic behavior of heart wall , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[24]  Kenneth I. Laws,et al.  Rapid Texture Identification , 1980, Optics & Photonics.

[25]  L. S. Davis Image Texture Analysis Techniques - a Survey , 1980 .

[26]  W. B. Thompson,et al.  Combining motion and contrast for segmentation , 1980, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[27]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[28]  Ramesh C. Jain,et al.  Extraction of Motion Information from Peripheral Processes , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[29]  T. O. Binford,et al.  Line Finding With Subpixel Precision , 1981, Other Conferences.

[30]  S. S. Reddi,et al.  Radial and Angular Moment Invariants for Image Identification , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  M. Shneier Calculations of geometric properties using quadtrees , 1981 .

[32]  Rodney A. Brooks,et al.  Symbolic Reasoning Among 3-D Models and 2-D Images , 1981, Artif. Intell..

[33]  Berthold K. P. Horn,et al.  Determining Optical Flow , 1981, Other Conferences.

[34]  Charles R. Giardina,et al.  Elliptic Fourier features of a closed contour , 1982, Comput. Graph. Image Process..

[35]  R. Haralick,et al.  The Topographic Primal Sketch , 1983 .

[36]  R.M. McElhaney,et al.  Algorithms for graphics and image processing , 1983, Proceedings of the IEEE.

[37]  Robert M. Haralick,et al.  Ridges and valleys on digital images , 1983, Comput. Vis. Graph. Image Process..

[38]  Ramakant Nevatia,et al.  Matching Images Using Linear Features , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[39]  Alex Pentland,et al.  Fractal-Based Description of Natural Scenes , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[40]  Hanan Samet,et al.  The Quadtree and Related Hierarchical Data Structures , 1984, CSUR.

[41]  Joseph Naor,et al.  Multiple Resolution Texture Analysis and Classification , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[42]  Leila De Floriani,et al.  Geometric modeling of solid objects by using a face adjacency graph representation , 1985, SIGGRAPH.

[43]  Ramakant Nevatia,et al.  Segment-based stereo matching , 1985, Comput. Vis. Graph. Image Process..

[44]  Robert M. Haralick,et al.  Topographic classification of digital image intensity surfaces using generalized splines and the discrete cosine transformation , 1984, Comput. Vis. Graph. Image Process..

[45]  A. Robert de Saint Vincent A 3D perception system for the mobile robot hilare , 1986, Proceedings. 1986 IEEE International Conference on Robotics and Automation.

[46]  Jake K. Aggarwal,et al.  Curvature-based representation of objects from range data , 1986, Image Vis. Comput..

[47]  B H Mayall,et al.  Characterization of chromatin distribution in cell nuclei. , 1986, Cytometry.

[48]  W. Eric L. Grimson,et al.  Localizing Overlapping Parts by Searching the Interpretation Tree , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[49]  James M. Keller,et al.  Characteristics of Natural Scenes Related to the Fractal Dimension , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[50]  Ramakant Nevatia,et al.  Segmented descriptions of 3-D surfaces , 1987, IEEE Journal on Robotics and Automation.

[51]  Mehdi Hatamian,et al.  Optical character recognition by the method of moments , 1987 .

[52]  Hanspeter Bieri,et al.  Computing the Euler characteristic and related additive functionals of digital objects from their bintree representation , 1987, Comput. Vis. Graph. Image Process..

[53]  Josef Bigün Recognition of local symmetries in gray value images by harmonic functions , 1988, [1988 Proceedings] 9th International Conference on Pattern Recognition.

[54]  Roland T. Chin,et al.  On image analysis by the methods of moments , 1988, Proceedings CVPR '88: The Computer Society Conference on Computer Vision and Pattern Recognition.

[55]  Ramesh C. Jain,et al.  Segmentation through Variable-Order Surface Fitting , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[56]  Franca Giannini,et al.  Automatic recognition and representation of shape-based features in a geometric modeling system , 1989, Comput. Vis. Graph. Image Process..

[57]  Christoph M. Hoffmann,et al.  Geometric and Solid Modeling: An Introduction , 1989 .

[58]  W. Eric L. Grimson On the Recognition of Curved Objects , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[59]  Ramakant Nevatia,et al.  Recognizing 3-D Objects Using Surface Descriptions , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[60]  James M. Keller,et al.  Texture description and segmentation through fractal geometry , 1989, Comput. Vis. Graph. Image Process..

[61]  Edward M. Riseman,et al.  Token-based extraction of straight lines , 1989, IEEE Trans. Syst. Man Cybern..

[62]  Larry S. Davis,et al.  Efficient Algorithms for Obstacle Detection Using Range Data , 1990, Comput. Vis. Graph. Image Process..

[63]  M. E. Jernigan,et al.  Texture Analysis and Discrimination in Additive Noise , 1990, Comput. Vis. Graph. Image Process..

[64]  Hsi-Jian Lee,et al.  Three-frame corner matching and moving object extraction in a sequence of images , 1990, Comput. Vis. Graph. Image Process..

[65]  Calvin C. Gotlieb,et al.  Texture descriptors based on co-occurrence matrices , 1990, Comput. Vis. Graph. Image Process..

[66]  Erkki Oja,et al.  Randomized Hough transform (RHT) , 1990, [1990] Proceedings. 10th International Conference on Pattern Recognition.

[67]  Josef Kittler,et al.  A hierarchical approach to line extraction based on the Hough transform , 1990, Comput. Vis. Graph. Image Process..

[68]  Josef Bigün,et al.  A structure feature for some image processing applications based on spiral functions , 1990, Comput. Vis. Graph. Image Process..

[69]  N. Ranganathan,et al.  Corner detection , 1990, Pattern Recognit..

[70]  T. Fan Describing and Recognizing 3-D Objects Using Surface Properties , 1989, Springer Series in Perception Engineering.

[71]  David J. Kriegman,et al.  On Recognizing and Positioning Curved 3-D Objects from Image Contours , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[72]  Svetha Venkatesh,et al.  On the classification of image features , 1990, Pattern Recognit. Lett..

[73]  J. Bigun A structure feature for some image processing applications based on spiral functions , 1990 .

[74]  Alireza Khotanzad,et al.  Invariant Image Recognition by Zernike Moments , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[75]  R. Voss Random Fractals: characterization and measurement , 1991 .

[76]  Fumitaka Kimura,et al.  Handwritten numerical recognition based on multiple algorithms , 1991, Pattern Recognit..

[77]  Robert M. Haralick,et al.  Glossary of computer vision terms , 1990, Pattern Recognit..

[78]  Ramesh C. Jain,et al.  An approach to three-dimensional image segmentation , 1991, CVGIP Image Underst..

[79]  Luc Vincent,et al.  Watersheds in Digital Spaces: An Efficient Algorithm Based on Immersion Simulations , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[80]  M. Turk,et al.  Eigenfaces for Recognition , 1991, Journal of Cognitive Neuroscience.

[81]  Azriel Rosenfeld,et al.  Image analysis and computer vision: 1990 , 1991, CVGIP Image Underst..

[82]  Thomas H. Reiss,et al.  The revised Fundamental Theorem of Moment Invariants , 1991, IEEE Trans. Pattern Anal. Mach. Intell..

[83]  A. Bruckstein,et al.  Differential invariants of planar curves and recognizing partially occluded shapes , 1992 .

[84]  David J. Kriegman,et al.  On using CAD models to compute the pose of curved 3D objects , 1992, CVGIP Image Underst..

[85]  Mindy Bokser,et al.  Omnidocument technologies , 1992, Proc. IEEE.

[86]  AZRIEL ROSENFELD,et al.  Image analysis and computer vision: 1991 , 1991, CVGIP Image Underst..

[87]  Andrew Zisserman,et al.  Introduction—towards a new framework for vision , 1992 .

[88]  André Oosterlinck,et al.  Shape recognition under affine distortions , 1992 .

[89]  Alfred M. Bruckstein,et al.  Invariant signatures for planar shape recognition under partial occlusion , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[90]  Azriel Rosenfeld,et al.  Image analysis and computer vision: 1992 , 1993 .

[91]  M. Levine,et al.  Extracting geometric primitives , 1993 .

[92]  Thomas S. Huang,et al.  Human face detection in a complex background , 1994, Pattern Recognit..

[93]  Azriel Rosenfeld Image analysis and computer vision: 1993 , 1994 .

[94]  Azriel Rosenfeld Image Analysis and Computer Vision: 1994 , 1995, Comput. Vis. Image Underst..

[95]  Rashpal S. Ahluwalia,et al.  Feature modification in incremental feature generation , 1995, Comput. Aided Des..

[96]  Miroslaw Pawlak,et al.  On Image Analysis by Moments , 1996, IEEE Trans. Pattern Anal. Mach. Intell..

[97]  JEFFREY WOOD,et al.  Invariant pattern recognition: A review , 1996, Pattern Recognit..

[98]  Josef Kittler,et al.  Defect detection in random colour textures , 1996, Image Vis. Comput..

[99]  Anil K. Jain,et al.  Feature extraction methods for character recognition-A survey , 1996, Pattern Recognit..

[100]  Rama Chellappa,et al.  A new approach to image feature detection with applications , 1996, Pattern Recognit..

[101]  Azriel Rosenfeld,et al.  Image Analysis and Computer Vision: 1995 , 1996, Comput. Vis. Image Underst..

[102]  Shih-Fu Chang,et al.  A highly efficient system for automatic face region detection in MPEG video , 1997, IEEE Trans. Circuits Syst. Video Technol..

[103]  Ivan Bricault,et al.  From Volume Medical Images to Quadratic Surface Patches , 1997, Comput. Vis. Image Underst..

[104]  Azriel Rosenfeld,et al.  Image Analysis and Computer Vision: 1996 , 1997, Comput. Vis. Image Underst..

[105]  Tony Lindeberg,et al.  Scale-Space Theory in Computer Vision , 1993, Lecture Notes in Computer Science.

[106]  Azriel Rosenfeld,et al.  Image Analysis and Computer Vision: 1997 , 1998, Comput. Vis. Image Underst..

[107]  Wen-Liang Hwang,et al.  Character extraction from documents using wavelet maxima , 1998, Image Vis. Comput..

[108]  Chin-Chuan Han,et al.  Facial feature detection using geometrical face model: An efficient approach , 1998, Pattern Recognit..

[109]  Josef Kittler,et al.  Histogram-based segmentation in a perceptually uniform color space , 1998, IEEE Trans. Image Process..

[110]  Anil K. Jain,et al.  On image classification: city images vs. landscapes , 1998, Pattern Recognit..

[111]  Ioannis Pitas,et al.  A novel method for automatic face segmentation, facial feature extraction and tracking , 1998, Signal Process. Image Commun..

[112]  Jan Flusser,et al.  Degraded Image Analysis: An Invariant Approach , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[113]  Ahmed M. Elgammal,et al.  Face detection in complex environments from color images , 1999, Proceedings 1999 International Conference on Image Processing (Cat. 99CH36348).

[114]  Paul L. Rosin Measuring Corner Properties , 1999, Comput. Vis. Image Underst..

[115]  Jian-Gang Wang,et al.  Frontal-view face detection and facial feature extraction using color and morphological operations , 1999, Pattern Recognit. Lett..

[116]  Meng Shi,et al.  Handwritten numeral recognition using gradient and curvature of gray scale image , 1999, Proceedings of the Fifth International Conference on Document Analysis and Recognition. ICDAR '99 (Cat. No.PR00318).

[117]  Niels da Vitoria Lobo,et al.  Features and Classification Methods to Locate Deciduous Trees in Images , 1999, Comput. Vis. Image Underst..

[118]  Shih-Fu Chang,et al.  Image Retrieval: Current Techniques, Promising Directions, and Open Issues , 1999, J. Vis. Commun. Image Represent..

[119]  Kazuhiko Yamamoto,et al.  On-line handwriting character recognition using direction-change features that consider imaginary strokes , 1999, Pattern Recognit..

[120]  Azriel Rosenfeld,et al.  Image Analysis and Computer Vision: 1998 , 1999, Comput. Vis. Image Underst..

[121]  Atsushi Imiya,et al.  The Euler Characteristics of Discrete Objects and Discrete Quasi-Objects , 1999, Comput. Vis. Image Underst..

[122]  Carlo Tomasi,et al.  Corner detection in textured color images , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[123]  Azriel Rosenfeld,et al.  Image Analysis and Computer Vision: 1999 , 2000, Comput. Vis. Image Underst..

[124]  Bisser Raytchev,et al.  User-independent online gesture recognition by relative motion extraction , 2000, Pattern Recognit. Lett..

[125]  Colin W. Morris,et al.  Analyzing the Mallat Wavelet Transform to Delineate Contour and Textural Features , 2000, Comput. Vis. Image Underst..

[126]  Anil K. Jain,et al.  Object localization using color, texture and shape , 2000, Pattern Recognit..

[127]  Ioannis Pitas,et al.  Facial feature extraction and pose determination , 2000, Pattern Recognit..

[128]  Murray H. Loew,et al.  Fully automatic 3D feature-based registration of multi-modality medical images , 2001, Image Vis. Comput..

[129]  Azriel Rosenfeld,et al.  From Image Analysis to Computer Vision: An Annotated Bibliography, 1955-1979 , 2001, Comput. Vis. Image Underst..

[130]  B. S. Manjunath,et al.  Color and texture descriptors , 2001, IEEE Trans. Circuits Syst. Video Technol..

[131]  Kuo-Chin Fan,et al.  Triangle-based approach to the detection of human face , 2001, Pattern Recognit..

[132]  Tony Lindeberg,et al.  Scale-space theory , 2001 .

[133]  Kin-Man Lam,et al.  An efficient algorithm for human face detection and facial feature extraction under different conditions , 2001 .

[134]  I. Jolliffe Principal Component Analysis , 2002 .

[135]  Nadia Magnenat-Thalmann,et al.  Facial feature extraction for quick 3D face modeling , 2002, Signal Process. Image Commun..

[136]  Igor B. Gurevich,et al.  A method of image recognition based on the fusion of reduced invariant representations: mathematical substantiation , 2002, Object recognition supported by user interaction for service robots.

[137]  Jan Flusser,et al.  Blur and affine moment invariants , 2002, Object recognition supported by user interaction for service robots.

[138]  Maria Petrou,et al.  Histogram ratio features for color texture classification , 2003, Pattern Recognit. Lett..

[139]  Adnan Amin,et al.  Fingerprint verification based on minutiae features: a review , 2004, Pattern Analysis and Applications.

[140]  Arivazhagan Selvaraj,et al.  Texture classification using wavelet transform , 2003, Pattern Recognit. Lett..

[141]  Eam Khwang Teoh,et al.  Bayesian shape model for facial feature extraction and recognition , 2003, Pattern Recognit..

[142]  Jouko Lampinen,et al.  Learning an Object Model for Feature Matching in Clutter , 2003, SCIA.

[143]  Cheng-Lin Liu,et al.  Handwritten digit recognition: benchmarking of state-of-the-art techniques , 2003, Pattern Recognit..

[144]  Jun-Wei Hsieh,et al.  Fast stitching algorithm for moving object detection and mosaic construction , 2003, 2003 International Conference on Multimedia and Expo. ICME '03. Proceedings (Cat. No.03TH8698).

[145]  Kuldip K. Paliwal,et al.  Fast features for face authentication under illumination direction changes , 2003, Pattern Recognit. Lett..

[146]  Igor B. Gurevich,et al.  Information Technology for the Morphological Analysis of the Lymphoid Cell Nuclei , 2003, SCIA.

[147]  Ewert Bengtsson,et al.  A Feature Set for Cytometry on Digitized Microscopic Images , 2003, Analytical cellular pathology : the journal of the European Society for Analytical Cellular Pathology.

[148]  Heinrich Niemann,et al.  Brain volumes characterisation using hierarchical neural networks , 2003, Artif. Intell. Medicine.

[149]  Gonzalo Pajares,et al.  A wavelet-based image fusion tutorial , 2004, Pattern Recognit..

[150]  Prabir Kumar Biswas,et al.  Cosine-modulated wavelet based texture features for content-based image retrieval , 2004, Pattern Recognit. Lett..

[151]  Erkki Oja,et al.  Statistical Shape Features for Content-Based Image Retrieval , 2004, Journal of Mathematical Imaging and Vision.

[152]  Andrew Beng Jin Teoh,et al.  An efficient fingerprint verification system using integrated wavelet and Fourier-Mellin invariant transform , 2004, Image Vis. Comput..

[153]  Mayer Aladjem,et al.  Regularized discriminant analysis for face recognition , 2004, Pattern Recognit..

[154]  Michael Brady,et al.  Enhancement and feature extraction for images of incised and ink texts , 2004, Image Vis. Comput..

[155]  Moumita Ghosh,et al.  A novel approach for structural feature extraction: Contour vs. direction , 2004, Pattern Recognit. Lett..

[156]  Rama Chellappa,et al.  Identification of humans using gait , 2004, IEEE Transactions on Image Processing.

[157]  Nanning Zheng,et al.  Non-negative matrix factorization based methods for object recognition , 2004, Pattern Recognit. Lett..

[158]  Arun K. Pujari,et al.  A wavelet based multiresolution algorithm for rotation invariant feature extraction , 2004, Pattern Recognit. Lett..

[159]  Jiebo Luo,et al.  A computational approach to determination of main subject regions in photographic images , 2004, Image Vis. Comput..

[160]  Mads Nielsen,et al.  Feature-Based Image Analysis , 2003, International Journal of Computer Vision.

[161]  Djemel Ziou,et al.  Image Retrieval from the World Wide Web: Issues, Techniques, and Systems , 2004, CSUR.

[162]  Hai-hui Wang,et al.  A New Multiwavelet-Based Approach to Image Fusion , 2004, Journal of Mathematical Imaging and Vision.

[163]  David Sinclair,et al.  Language-based querying of image collections on the basis of an extensible ontology , 2004, Image Vis. Comput..

[164]  Samir Al-Khayatt,et al.  Fast Robust Fingerprint Feature Extraction and Classification , 2004, J. Intell. Robotic Syst..

[165]  Frank Y. Shih,et al.  Automatic extraction of head and face boundaries and facial features , 2004, Inf. Sci..

[166]  Zehang Sun,et al.  Object detection using feature subset selection , 2004, Pattern Recognit..

[167]  Haesun Park,et al.  Fingerprint classification using fast Fourier transform and nonlinear discriminant analysis , 2005, Pattern Recognit..

[168]  Seong-Whan Lee,et al.  Tracking non-rigid objects using probabilistic Hausdorff distance matching , 2005, Pattern Recognit..

[169]  Wei He,et al.  Image mining for investigative pathology using optimized feature extraction and data fusion , 2005, Comput. Methods Programs Biomed..

[170]  Igor B. Gurevich,et al.  The Descriptive Approach to Image Analysis Current State and Prospects , 2005, SCIA.

[171]  Daoqiang Zhang,et al.  Feature extraction approaches based on matrix pattern: MatPCA and MatFLDA , 2005, Pattern Recognit. Lett..

[172]  Jian Yang,et al.  Two-dimensional discriminant transform for face recognition , 2005, Pattern Recognit..

[173]  N. K. Kamila,et al.  Invariance image analysis using modified Zernike moments , 2005, Pattern Recognit. Lett..

[174]  Jianping Fan,et al.  Statistical modeling and conceptualization of natural images , 2005, Pattern Recognit..

[175]  Ming Li,et al.  2D-LDA: A statistical linear discriminant analysis for image matrix , 2005, Pattern Recognit. Lett..

[176]  ChenSongcan,et al.  Feature extraction approaches based on matrix pattern , 2005 .

[177]  Changsong Liu,et al.  Gabor filters-based feature extraction for character recognition , 2005, Pattern Recognit..