Semantic Regions Recognition in UAV Images Sequence

In this work, we describe a framework to analyze UAV videos content. A multi-class image segmentation approach is proposed considering UAV videos specific characteristics. A static image segmentation is applied on each frame. After a preprocessing step on resulting segments, a SVM classifier is used to recognize regions. A Markov model is introduced to combine the results from the previous frames in order to improve the accuracy. The framework has been designed to be as flexible as possible with an eye to allow to insert holistic information into the model.

[1]  Alexei A. Efros,et al.  Putting Objects in Perspective , 2006, 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06).

[2]  Jon Atli Benediktsson,et al.  Classification and feature extraction for remote sensing images from urban areas based on morphological transformations , 2003, IEEE Trans. Geosci. Remote. Sens..

[3]  Dorin Comaniciu,et al.  Mean shift analysis and applications , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[4]  J. Serra,et al.  An overview of morphological filtering , 1992 .

[5]  Bill Triggs,et al.  Histograms of oriented gradients for human detection , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[6]  Larry D. Hostetler,et al.  The estimation of the gradient of a density function, with applications in pattern recognition , 1975, IEEE Trans. Inf. Theory.

[7]  Nick G. Kingsbury,et al.  Semantic discriminant mapping for classification and browsing of remote sensing textures and objects , 2005, IEEE International Conference on Image Processing 2005.

[8]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[9]  Chih-Jen Lin,et al.  A comparison of methods for multiclass support vector machines , 2002, IEEE Trans. Neural Networks.

[10]  C. Clark,et al.  A glacier respires: Quantifying the distribution and respiration CO2 flux of cryoconite across an entire Arctic supraglacial ecosystem , 2007 .

[11]  Gérard Dreyfus,et al.  Single-layer learning revisited: a stepwise procedure for building and training a neural network , 1989, NATO Neurocomputing.

[12]  Guoqing Zhou,et al.  DETECTING AND COUNTING VEHICLES FROM SMALL LOW-COST UAV IMAGES , 2009 .

[13]  Stefano Soatto,et al.  Class segmentation and object localization with superpixel neighborhoods , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[14]  H. Maas,et al.  Quantitative Measurement of Soil Erosion from Tls and Uav Data , 2013 .

[15]  Dorin Comaniciu,et al.  Mean Shift: A Robust Approach Toward Feature Space Analysis , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[16]  Antonio Criminisi,et al.  TextonBoost: Joint Appearance, Shape and Context Modeling for Multi-class Object Recognition and Segmentation , 2006, ECCV.

[17]  Stephen Gould,et al.  Region-based Segmentation and Object Detection , 2009, NIPS.

[18]  S. Ali Etemad,et al.  Robust Horizon Detection Using Segmentation for UAV Applications , 2012, 2012 Ninth Conference on Computer and Robot Vision.

[19]  Ramakant Nevatia,et al.  Building Detection and Description from a Single Intensity Image , 1998, Comput. Vis. Image Underst..

[20]  David G. Lowe,et al.  Distinctive Image Features from Scale-Invariant Keypoints , 2004, International Journal of Computer Vision.

[21]  Matti Pietikäinen,et al.  Multiresolution Gray-Scale and Rotation Invariant Texture Classification with Local Binary Patterns , 2002, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Stephen Gould,et al.  Decomposing a scene into geometric and semantically consistent regions , 2009, 2009 IEEE 12th International Conference on Computer Vision.