Dense Structure Inference for Object Classification in Aerial LIDAR Dataset

We present a framework to classify small freeform objects in 3D aerial scans of a large urban area. The system first identifies large structures such as the ground surface and roofs of buildings densely built in the scene, by fitting planar patches and grouping adjacent patches similar in pose together. Then, it segments initial object candidates which represent the visible surface of an object using the identified structures. To deal with sparse density in points representing each candidate, we also propose a novel method to infer a dense 3D structure from the given sparse and noisy points without any meshes and iterations. To label object candidates, we build a tree-structure database of object classes, which captures latent patterns in shape of 3D objects in a hierarchical manner. We demonstrate our system on the aerial LIDAR dataset acquired from a few square kilometers of Ottawa.

[1]  Martin Rumpf,et al.  A finite element method for surface restoration with smooth boundary conditions , 2004, Comput. Aided Geom. Des..

[2]  Ben Taskar,et al.  Discriminative learning of Markov random fields for segmentation of 3D scan data , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[3]  Vladimir G. Kim,et al.  Shape-based recognition of 3D point clouds in urban environments , 2009, 2009 IEEE 12th International Conference on Computer Vision.

[4]  Gérard G. Medioni,et al.  Urban scene understanding from aerial and ground LIDAR data , 2010, Machine Vision and Applications.

[5]  Katsushi Ikeuchi,et al.  Hole Filling of a 3D Model by Flipping Signs of a Signed Distance Field in Adaptive Resolution , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[6]  Peter Liepa,et al.  Filling Holes in Meshes , 2003, Symposium on Geometry Processing.

[7]  Mi-Suen Lee,et al.  A Computational Framework for Segmentation and Grouping , 2000 .

[8]  Takeshi Masuda,et al.  Filling the signed distance field by fitting local quadrics , 2004, Proceedings. 2nd International Symposium on 3D Data Processing, Visualization and Transmission, 2004. 3DPVT 2004..

[9]  Guillermo Sapiro,et al.  Inpainting surface holes , 2003, Proceedings 2003 International Conference on Image Processing (Cat. No.03CH37429).

[10]  Martial Hebert,et al.  Contextual classification with functional Max-Margin Markov Networks , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.