A Parametric Algorithm for Skyline Extraction

This paper is dedicated to the problem of automatic skyline extraction in digital images. The study is motivated by the needs, expressed by urbanists, to describe in terms of geometrical features, the global shape created by man-made buildings in urban areas. Skyline extraction has been widely studied for navigation of Unmanned Aerial Vehicles (drones) or for geolocalization, both in natural and urban contexts. In most of these studies, the skyline is defined by the limit between sky and ground objects, and can thus be resumed to the sky segmentation problem in images. In our context, we need a more generic definition of skyline, which makes its extraction more complex and even variable. The skyline can be extracted for different depths, depending on the interest of the user (far horizon, intermediate buildings, near constructions , ...), and thus requires a human interaction. The main steps of our method are as follows: we use a Canny filter to extract edges and allow the user to interact with filter's parameters. With a high sensitivity , all the edges will be detected, whereas with lower values, only most contrasted contours will be kept by the filter. From the obtained edge map, an upper envelope is extracted, which is a disconnected approximation of the skyline. A graph is then constructed and a shortest path algorithm is used to link discontinuities. Our approach has been tested on several public domain urban and natural databases, and have proven to give better results that previously published methods.

[1]  Anuar Mohd Noor,et al.  City Skyline Conservation: Sustaining the Premier Image of Kuala Lumpur☆ , 2014 .

[2]  Matthew Brand,et al.  Geolocalization using skylines from omni-images , 2009, 2009 IEEE 12th International Conference on Computer Vision Workshops, ICCV Workshops.

[3]  Jin-Soo Kim,et al.  Skyline Extraction using a Multistage Edge Filtering , 2011 .

[4]  Tian Zhang,et al.  Improvement of registration accuracy of a handheld augmented reality system for urban landscape simulation , 2014 .

[5]  Matthew Brand,et al.  SKYLINE2GPS: Localization in urban canyons using omni-skylines , 2010, 2010 IEEE/RSJ International Conference on Intelligent Robots and Systems.

[6]  Luce Morin,et al.  Video/GIS registration system based on skyline matching method , 2013, 2013 IEEE International Conference on Image Processing.

[7]  Wen-Nung Lie,et al.  A robust dynamic programming algorithm to extract skyline in images for navigation , 2005, Pattern Recognit. Lett..

[8]  Gregory Dudek,et al.  Urban Position Estimation from One Dimensional Visual Cues , 2006, The 3rd Canadian Conference on Computer and Robot Vision (CRV'06).

[9]  Pascal Vasseur,et al.  Dynamic programming and skyline extraction in catadioptric infrared images , 2009, 2009 IEEE International Conference on Robotics and Automation.

[10]  Marc Pollefeys,et al.  Large Scale Visual Geo-Localization of Images in Mountainous Terrain , 2012, ECCV.

[11]  M. Fang,et al.  Skyline For Video-based Virtual Rail For Vehicle Navigation , 1993, Proceedings of the Intelligent Vehicles '93 Symposium.

[12]  Svetlana Lazebnik,et al.  Superparsing , 2010, International Journal of Computer Vision.

[13]  Taishi Murata,et al.  Development of a Positioning Technique for an Urban Area Using Omnidirectional Infrared Camera and Aerial Survey Data , 2008, Adv. Robotics.

[14]  Jin Soo Kim,et al.  Robust skyline extraction algorithm for mountainous images , 2007, VISAPP.

[15]  Marc Pollefeys,et al.  Image Based Geo-localization in the Alps , 2016, International Journal of Computer Vision.

[16]  Jiebo Luo,et al.  A physical model-based approach to detecting sky in photographic images , 2002, IEEE Trans. Image Process..