A system for model-based object recognition in perspective aerial images

Abstract Recognition of objects in complex, perspective aerial imagery is difficult because of occlusion, shadow, clutter and various forms of image degradation. This paper presents a system for aircraft recognition under real-world conditions. The particular approach is based on the use of a hierarchical database of object models and involves three key processes: (a) The qualitative object recognition process performs heterogeneous model-based symbolic feature extraction and generic object recognition; (b) The refocused matching and evaluation process refines the extracted features for more specific classification with input from (a); and (c) The primitive feature extraction process regulates the extracted features based on their saliency and interacts with (a) and (b). Experimental results showing the qualitative recognition of aircraft in perspective, aerial images are presented.

[1]  Marc H. Raibert,et al.  Running With Symmetry , 1986 .

[2]  Owen Robert Mitchell,et al.  Partial Shape Recognition Using Dynamic Programming , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Jake K. Aggarwal,et al.  Model Construction and Shape Recognition from Occluding Contours , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Robert B. McGhee,et al.  Aircraft Identification by Moment Invariants , 1977, IEEE Transactions on Computers.

[5]  Keinosuke Fukunaga,et al.  Three-Dimensional Shape Analysis Using Local Shape Descriptors , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Stéphane Houzelle,et al.  Interpretation of remotely sensed images in a context of multisensor fusion using a multispecialist architecture , 1993, IEEE Trans. Geosci. Remote. Sens..

[7]  Jun Ma,et al.  A fast shape descriptor , 1986, Comput. Vis. Graph. Image Process..

[8]  Ramakant Nevatia,et al.  Detecting buildings in aerial images , 1988, Comput. Vis. Graph. Image Process..

[9]  Sing-Tze Bow,et al.  Pattern recognition and image preprocessing , 1992 .

[10]  Bir Bhanu,et al.  Closed-Loop Object Recognition Using Reinforcement Learning , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[11]  Greg Gibbon.  Weighted chord functions , 1988, Pattern Recognit..

[12]  P. Wintz,et al.  An efficient three-dimensional aircraft recognition algorithm using normalized fourier descriptors , 1980 .

[13]  David G. Lowe,et al.  Perceptual Organization and Visual Recognition , 2012 .

[14]  Robert C. Bolles,et al.  3DPO: A Three- Dimensional Part Orientation System , 1986, IJCAI.

[15]  Zen Chen,et al.  Computer vision for robust 3D aircraft recognition with fast library search , 1991, Pattern Recognit..

[16]  Larry S. Davis,et al.  Hierarchical Constraint Processes for Shape Analysis , 1981, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[17]  D. W. Thompson,et al.  Three-dimensional model matching from an unconstrained viewpoint , 1987, Proceedings. 1987 IEEE International Conference on Robotics and Automation.

[18]  Jezekiel Ben-Arie,et al.  3D objects recognition by optimal matching search of multinary relations graphs , 1987, Comput. Vis. Graph. Image Process..

[19]  Rama Chellappa,et al.  Classification of Partial 2-D Shapes Using Fourier Descriptors , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[20]  Anthony P. Reeves,et al.  Three-Dimensional Shape Analysis Using Moments and Fourier Descriptors , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  J. McDermott,et al.  Rule-Based Interpretation of Aerial Imagery , 1984, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  D.I. Moldovan,et al.  A Hierarchical Knowledge Based System for Airplane Classification , 1988, IEEE Trans. Software Eng..

[23]  Shimon Ullman,et al.  Structural Saliency: The Detection Of Globally Salient Structures using A Locally Connected Network , 1988, [1988 Proceedings] Second International Conference on Computer Vision.

[24]  R. Bruce Irvin,et al.  Methods For Exploiting The Relationship Between Buildings And Their Shadows In Aerial Imagery , 1989, Photonics West - Lasers and Applications in Science and Engineering.

[25]  Mandyam D. Srinath,et al.  Invariant planar shape recognition using dynamic alignment , 1988, Pattern Recognit..

[26]  Bir Bhanu,et al.  Refocused Recognition Of Aerial Photographs At Multiple Resolution , 1989, Defense, Security, and Sensing.

[27]  Mandyam D. Srinath,et al.  Contour sequence moments for the classification of closed planar shapes , 1987, Pattern Recognit..

[28]  Darwin Kuan,et al.  Lockheed imaging technology research for missiles and space , 1989 .

[29]  Bir Bhanu,et al.  Model-based segmentation of FLIR images , 1990 .

[30]  Bir Bhanu,et al.  Generic object recognition using multiple representations , 1996, Image Vis. Comput..

[31]  Anthony P. Reeves,et al.  Identification of Three-Dimensional Objects Using Range Information , 1989, IEEE Trans. Pattern Anal. Mach. Intell..

[32]  Thomas S. Huang,et al.  Using the creation machine to locate airplanes on aerial photos , 1980, Pattern Recognit..