Object Classification using Hybrid Holistic Descriptors: Application to Building Detection in Aerial Orthophotos

We present a framework for automatic and accurate multiple detection of objects of interest from images using hybrid image descriptors. The proposed framework combines a powerful segmentation algorithm with a hybrid descriptor. The hybrid descriptor is composed by color histograms and several Local Binary Patterns based descriptors. The proposed framework involves two main steps. The first one consists in segmenting the image into homogeneous regions. In the second step, in order to separate the objects of interest and the image background, the hybrid descriptor of each region is classiied using machine learning tools and a gallery of training descriptors. To show its performance, the method is applied to extract building roofs from orthophotos. We provide evaluation performances over 100 buildings. The proposed approach presents several advantages in terms of applicability, suitability and simplicity. We also show that the use of hybrid descriptors lead to an enhanced performance

[1]  Jenq-Neng Hwang,et al.  Adaptive particle sampling and adaptive appearance for multiple video object tracking , 2009, Signal Process..

[2]  Marie-Pierre Jolly,et al.  Interactive Graph Cuts for Optimal Boundary and Region Segmentation of Objects in N-D Images , 2001, ICCV.

[3]  Pascal Fua,et al.  SLIC Superpixels Compared to State-of-the-Art Superpixel Methods , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[4]  Witold Pedrycz,et al.  Local descriptors in application to the aging problem in face recognition , 2013, Pattern Recognit..

[5]  Noel E. O'Connor,et al.  A comparative evaluation of interactive segmentation algorithms , 2010, Pattern Recognit..

[6]  Aiko M. Hormann,et al.  Programs for Machine Learning. Part I , 1962, Inf. Control..

[7]  R. Taylor A User's Guide to Measure-Theoretic Probability , 2003 .

[8]  Oliver Wang,et al.  A Bayesian Approach to Building Footprint Extraction from Aerial LIDAR Data , 2006, Third International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT'06).

[9]  D. Kibler,et al.  Instance-based learning algorithms , 2004, Machine Learning.

[10]  Marko Grobelnik,et al.  Subspace, Latent Structure and Feature Selection techniques , 2006 .

[11]  Andrew Blake,et al.  "GrabCut" , 2004, ACM Trans. Graph..

[12]  Matti Pietikäinen,et al.  Face Description with Local Binary Patterns: Application to Face Recognition , 2006, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[14]  Yaniv Taigman,et al.  Descriptor Based Methods in the Wild , 2008 .

[15]  Kurt Hornik,et al.  The support vector machine under test , 2003, Neurocomputing.

[16]  O. Tournaire,et al.  An efficient stochastic approach for building footprint extraction from digital elevation models , 2010 .

[17]  J. Ross Quinlan,et al.  C4.5: Programs for Machine Learning , 1992 .

[18]  Rolf Adams,et al.  Seeded Region Growing , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[19]  Matti Pietikäinen,et al.  Block-Based Methods for Image Retrieval Using Local Binary Patterns , 2005, SCIA.

[20]  Marie-Pierre Jolly,et al.  Interactive graph cuts for optimal boundary & region segmentation of objects in N-D images , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[21]  Sven J. Dickinson,et al.  TurboPixels: Fast Superpixels Using Geometric Flows , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  Raúl Rojas,et al.  SIOX: simple interactive object extraction in still images , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[23]  Jesús S. Aguilar-Ruiz,et al.  An Instance Based Learning Model for Classification in Data Streams with Concept Change , 2012, 2012 11th Mexican International Conference on Artificial Intelligence.