True orthophoto generation using line segment matches

When generating a true orthophoto from aerial urban scenes, especially those containing man‐made features with large height differences, sawtooth effects in feature edges can occur in the rectified images. Aiming to eliminate such effects, this study proposes an advanced orthorectification method using line segment matches, allowing 3D building edges to be accurately reconstructed. The corresponding 2D line segments are first extracted and matched, enabling the reconstruction of 3D line segments by joining two planes and imposing a line end‐point constraint. The 3D line segments are then dissected into discrete 3D points to be incorporated into the 3D point cloud obtained by a dense matching algorithm. Finally, a more complete and accurate triangulated irregular network (TIN) model can be constructed to provide important basic data for true orthophoto production. Experimental results show that sawtooth effects can be eliminated, resulting in significantly improved quality in the true orthophotograph.

[1]  Josef Jansa,et al.  THE GENERATION OF TRUE ORTHOPHOTOS USING A 3D BUILDING MODEL IN CONJUNCTION WITH A CONVENTIONAL DTM , 1998 .

[2]  Sunghee Choi,et al.  A simple algorithm for homeomorphic surface reconstruction , 2000, SCG '00.

[3]  Takeo Kanade,et al.  A Cooperative Algorithm for Stereo Matching and Occlusion Detection , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[4]  Christian Heipke,et al.  Building extraction from aerial imagery using a generic scene model and invariant geometric moments , 2001, IEEE/ISPRS Joint Workshop on Remote Sensing and Data Fusion over Urban Areas (Cat. No.01EX482).

[5]  A. Habib,et al.  Bundle Adjustment with Self–Calibration Using Straight Lines , 2002 .

[6]  Chia-Hsiang Menq,et al.  Combinatorial manifold mesh reconstruction and optimization from unorganized points with arbitrary topology , 2002, Comput. Aided Des..

[7]  W. Schickler,et al.  OPERATIONAL PROCEDURE FOR AUTOMATIC TRUE ORTHOPHOTO GENERATION , 2003 .

[8]  Manchun Li,et al.  A methodology for true orthorectification of large-scale urban aerial images and automatic detection of building occlusions using digital surface model , 2003, IGARSS 2003. 2003 IEEE International Geoscience and Remote Sensing Symposium. Proceedings (IEEE Cat. No.03CH37477).

[9]  Tamal K. Dey,et al.  Provable surface reconstruction from noisy samples , 2004, SCG '04.

[10]  Peng Gong,et al.  Integrated shadow removal based on photogrammetry and image analysis , 2005 .

[11]  Weirong Chen,et al.  A comprehensive study on urban true orthorectification , 2005, IEEE Transactions on Geoscience and Remote Sensing.

[12]  Hongli Deng,et al.  3D Object Reconstruction using Line and Point Feature Matching , 2005, Computer Graphics and Imaging.

[13]  Guoqing Zhou,et al.  Accuracy improvement of urban true orthoimage generation using 3D R-tree-based urban model , 2006, DG.O.

[14]  Tee-Ann Teo,et al.  Occlusion-Compensated True Orthorectification For High-Resolution Satellite Images , 2007 .

[15]  Changjae Kim,et al.  New Methodologies for True Orthophoto Generation , 2007 .

[16]  Yongwei Sheng,et al.  Minimising algorithm‐induced artefacts in true ortho‐image generation: a direct method implemented in the vector domain , 2007 .

[17]  Hsi-Yung Feng,et al.  A progressive point cloud simplification algorithm with preserved sharp edge data , 2009 .

[18]  Joe McMahon,et al.  Automated imagery orthorectification pilot , 2009 .

[19]  U. Neumann,et al.  Line segment matching and its applications in 3d urban modeling , 2010 .

[20]  Lei Yan,et al.  Large-scale monocular SLAM by local bundle adjustment and map joining , 2010, 2010 11th International Conference on Control Automation Robotics & Vision.

[21]  Luca Di Angelo,et al.  A new mesh-growing algorithm for fast surface reconstruction , 2011, Comput. Aided Des..

[22]  Mingyue Ding,et al.  Denoising point cloud , 2012 .

[23]  Xiangyun Hu,et al.  FAST OCCLUSION AND SHADOW DETECTION FOR HIGH RESOLUTION REMOTE SENSING IMAGE COMBINED WITH LIDAR POINT CLOUD , 2012 .

[24]  R. Goossens,et al.  Airborne photogrammetry and lidar for DSM extraction and 3D change detection over an urban area – a comparative study , 2013 .

[25]  Michael M. Kazhdan,et al.  Screened poisson surface reconstruction , 2013, TOGS.

[26]  Horst Bischof,et al.  Probabilistic Range Image Integration for DSM and True-Orthophoto Generation , 2013, SCIA.

[27]  Keiichi Uchimura,et al.  Automatic Road Extraction Using Seeded Region Growing with Mixed ART Method for DSM Data , 2013 .

[28]  Peter Reinartz,et al.  Building Reconstruction Using DSM and Orthorectified Images , 2013, Remote. Sens..

[29]  M. Rothermel,et al.  SURE : PHOTOGRAMMETRIC SURFACE RECONSTRUCTION FROM IMAGER Y , 2013 .

[30]  Lei Yan,et al.  A new feature parametrization for monocular SLAM using line features , 2014, Robotica.

[31]  Jan Dirk Wegner,et al.  Theme section “Urban object detection and 3D building reconstruction” , 2014 .

[32]  Gamini Dissanayake,et al.  L2-SIFT: SIFT feature extraction and matching for large images in large-scale aerial photogrammetry , 2014 .

[33]  Lei Yan,et al.  Line matching based on planar homography for stereo aerial images , 2015 .

[34]  Xiangguo Lin,et al.  Edge Detection and Feature Line Tracing in 3D-Point Clouds by Analyzing Geometric Properties of Neighborhoods , 2016, Remote. Sens..

[35]  Shiyue Fan,et al.  Line matching using a disparity map in rectified image space for stereo aerial images , 2016 .

[36]  Guojun Lu,et al.  An Automatic Building Extraction and Regularisation Technique Using LiDAR Point Cloud Data and Orthoimage , 2016, Remote. Sens..

[37]  Emanuele Mandanici,et al.  Integration of Aerial Thermal Imagery, LiDAR Data and Ground Surveys for Surface Temperature Mapping in Urban Environments , 2016, Remote. Sens..