FACADE INTERPRETATION USING A MARKED POINT PROCESS

Abstract. Our objective is the interpretation of facade images in a top-down manner, using a Markov marked point process formulated as a Gibbs process. Given single rectified facade images, we aim at the accurate detection of relevant facade objects as windows and entrances, using prior knowledge about their possible configurations within facade images. We represent facade objects by a simplified rectangular object model and present an energy model, which evaluates the agreement of a proposed configuration with the given image and the statistics about typical configurations, which we learned from training data. We show promising results on different datasets and provide a qualitative evaluation, which demonstrates the capability of complete and accurate detection of facade objects.

[1]  O. Tournaire,et al.  Extracting polygonal building footprints from digital surface models: A fully-automatic global optimization framework , 2013 .

[2]  Florent Lafarge,et al.  Geometric Feature Extraction by a Multimarked Point Process , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Radim Sára,et al.  Windowpane Detection Based on Maximum Aposteriori Probability Labeling , 2008, IWCIA Special Track on Applications.

[4]  C. Geyer,et al.  Simulation Procedures and Likelihood Inference for Spatial Point Processes , 1994 .

[5]  Andrew Zisserman,et al.  New Techniques for Automated Architectural Reconstruction from Photographs , 2002, ECCV.

[6]  W. Förstner,et al.  COMBINE MARKOV RANDOM FIELDS AND MARKED POINT PROCESSES TO EXTRACT BUILDING FROM REMOTELY SENSED IMAGES , 2012 .

[7]  Franz Leberl,et al.  Windows Detection Using K-means in CIE-Lab Color Space , 2010, 2010 20th International Conference on Pattern Recognition.

[8]  Wolfgang Förstner,et al.  LEARNING A COMPOSITIONAL REPRESENTATION FOR FACADE OBJECT CATEGORIZATION , 2012 .

[9]  Josiane Zerubia,et al.  A Marked Point Process of Rectangles and Segments for Automatic Analysis of Digital Elevation Models , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[10]  Ramakant Nevatia,et al.  Extraction and integration of window in a 3D building model from ground view images , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[11]  Long Quan,et al.  Structure-driven facade parsing with irregular patterns , 2015, 2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).

[12]  Renaud Marlet,et al.  A MRF shape prior for facade parsing with occlusions , 2015, CVPR.

[13]  Wolfgang Förstner,et al.  eTRIMS Image Database for Interpreting Images of Man-Made Scenes , 2009 .

[14]  Radim Sára,et al.  A Weak Structure Model for Regular Pattern Recognition Applied to Facade Images , 2010, ACCV.

[15]  Ji Zhu,et al.  Kernel Logistic Regression and the Import Vector Machine , 2001, NIPS.

[16]  P. Green.  Reversible jump Markov chain Monte Carlo computation and Bayesian model determination , 1995 .

[17]  Ribana Roscher,et al.  Incremental Import Vector Machines for Classifying Hyperspectral Data , 2012, IEEE Transactions on Geoscience and Remote Sensing.

[18]  Florent Lafarge,et al.  Detecting parametric objects in large scenes by Monte Carlo sampling , 2013, International Journal of Computer Vision.

[19]  Lucas Paletta,et al.  Window Detection in Facades , 2007, 14th International Conference on Image Analysis and Processing (ICIAP 2007).

[20]  Joachim Denzler,et al.  A Fast Approach for Pixelwise Labeling of Facade Images , 2010, 2010 20th International Conference on Pattern Recognition.

[21]  Luc Van Gool,et al.  Image-based procedural modeling of facades , 2007, SIGGRAPH 2007.

[22]  Yanxi Liu,et al.  Translation-Symmetry-Based Perceptual Grouping with Applications to Urban Scenes , 2010, ACCV.

[23]  Florent Lafarge,et al.  Texture Representation by Geometric Objects using a Jump-Diffusion Process , 2008, BMVC.

[24]  Attila Börcs,et al.  A MARKED POINT PROCESS MODEL FOR VEHICLE DETECTION IN AERIAL LIDAR POINT CLOUDS , 2012 .

[25]  Frank Dellaert,et al.  A Probabilistic Approach to the Semantic Interpretation of Building Facades , 2004 .

[26]  Hervé Le Men,et al.  Building detection by Markov object processes , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[27]  O. Tournaire,et al.  An efficient stochastic approach for building footprint extraction from digital elevation models , 2010 .

[28]  Nikos Paragios,et al.  Segmentation of building facades using procedural shape priors , 2010, 2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[29]  Florent Lafarge,et al.  RECTANGULAR ROAD MARKING DETECTION WITH MARKED POINT PROCESSES , 2007 .

[30]  Bruno Vallet,et al.  Detecting blind building façades from highly overlapping wide angle aerial imagery , 2014 .

[31]  Nora Ripperda.  DETERMINATION OF FACADE ATTRIBUTES FOR FACADE RECONSTRUCTION , 2007 .

[32]  Luc Van Gool,et al.  A Three-Layered Approach to Facade Parsing , 2012, ECCV.

[33]  Horst Bischof,et al.  Unsupervised Facade Segmentation Using Repetitive Patterns , 2010, DAGM-Symposium.

[34]  SUSANNE WENZEL,et al.  DETECTION AND DESCRIPTION OF REPEATED STRUCTURES IN RECTIFIED FACADE IMAGES , 2008 .

[35]  Josiane Zerubia,et al.  Structural Approach for Building Reconstruction from a Single DSM , 2010, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[36]  A. Baddeley,et al.  Stochastic geometry models in high-level vision , 1993 .

[37]  Roberto Cipolla,et al.  Modelling and Interpretation of Architecture from Several Images , 2004, International Journal of Computer Vision.

[38]  Ribana Roscher,et al.  I2VM: Incremental import vector machines , 2012, Image Vis. Comput..

[39]  Josiane Zerubia,et al.  A RJMCMC Algorithm for Object Processes in Image Processing , 2001, Monte Carlo Methods Appl..

[40]  Marc Pollefeys,et al.  Efficient Structured Parsing of Facades Using Dynamic Programming , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[41]  Josiane Zerubia,et al.  Building Outline Extraction from Digital Elevation Models Using Marked Point Processes , 2007, International Journal of Computer Vision.

[42]  Frédéric Jurie,et al.  Groups of Adjacent Contour Segments for Object Detection , 2008, IEEE Trans. Pattern Anal. Mach. Intell..