Perspective Distortion Modeling for Image Measurements

A perspective distortion modelling for monocular view that is based on the fundamentals of perspective projection is presented in this work. Perspective projection is considered to be the most ideal and realistic model among others, which depicts image formation in monocular vision. There are many approaches trying to model and estimate the perspective effects in images. Some approaches try to learn and model the distortion parameters from a set of training data that work only for a predefined structure. None of the existing methods provide deep understanding of the nature of perspective problems. Perspective distortions, in fact, can be described by three different perspective effects. These effects are pose, distance and foreshortening. They are the cause of the aberrant appearance of object shapes in images. Understanding these phenomena have long been an interesting topic for artists, designers and scientists. In many cases, this problem has to be necessarily taken into consideration when dealing with image diagnostics, high and accurate image measurement, as well as accurate pose estimation from images. In this work, a perspective distortion model for every effect is developed while elaborating the nature of perspective effects. A distortion factor for every effect is derived, then followed by proposed methods, which allows extracting the true target pose and distance, and correcting image measurements.

[1]  Yue Zhao,et al.  Perspective projection model for prism-based stereovision. , 2015, Optics express.

[2]  Svetha Venkatesh,et al.  CCTV Scene Perspective Distortion Estimation From Low-Level Motion Features , 2016, IEEE Transactions on Circuits and Systems for Video Technology.

[3]  Daniel D. Lee,et al.  Online self-supervised monocular visual odometry for ground vehicles , 2015, 2015 IEEE International Conference on Robotics and Automation (ICRA).

[4]  Metin Soycan,et al.  Perspective correction of building facade images for architectural applications , 2019, Engineering Science and Technology, an International Journal.

[5]  Stefano Soatto,et al.  Perspective distortion modeling, learning and compensation , 2015, 2015 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[6]  Carlos Ricolfe-Viala,et al.  Lens distortion models evaluation. , 2010, Applied optics.

[7]  Aleksandr Yurievich Brailov Engineering Graphics: Theoretical Foundations of Engineering Geometry for Design , 2016 .

[8]  Min Feng,et al.  Fast reducing perspective distortion for road marking recognition , 2017, 2017 IEEE 20th International Conference on Intelligent Transportation Systems (ITSC).

[9]  Robert C. Bolles,et al.  Random sample consensus: a paradigm for model fitting with applications to image analysis and automated cartography , 1981, CACM.

[10]  Mark Whitty,et al.  Robotics, Vision and Control. Fundamental Algorithms in MATLAB , 2012 .

[11]  R. Matsuoka,et al.  ECCENTRICITY ON AN IMAGE CAUSED BY PROJECTION OF A CIRCLE AND A SPHERE , 2016 .

[12]  Changsong Liu,et al.  Layout and Perspective Distortion Independent Recognition of Captured Chinese Document Image , 2017, 2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).

[13]  Pascal Monasse,et al.  A Precision Analysis of Camera Distortion Models , 2017, IEEE Trans. Image Process..

[14]  Shang-Hong Lai,et al.  Correcting radial and perspective distortion by using face shape information , 2015, 2015 11th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[15]  Samia Nefti-Meziani,et al.  Introducing a novel marker-based geometry model in monocular vision , 2016, 2016 13th Workshop on Positioning, Navigation and Communications (WPNC).

[16]  Zhongli Wang,et al.  A practical distortion correcting method from fisheye image to perspective projection image , 2015, 2015 IEEE International Conference on Information and Automation.

[17]  Tiziana D'Orazio,et al.  A ball detection algorithm for real soccer image sequences , 2002, Object recognition supported by user interaction for service robots.

[18]  Jing Dong,et al.  Position Determines Perspective: Investigating Perspective Distortion for Image Forensics of Faces , 2017, 2017 IEEE Conference on Computer Vision and Pattern Recognition Workshops (CVPRW).

[19]  Meenakshisundaram Gopi,et al.  Correcting perceived perspective distortions using object specific planar transformations , 2016, 2016 IEEE International Conference on Computational Photography (ICCP).

[20]  Yiannis Aloimonos,et al.  Perspective approximations , 1990, Image Vis. Comput..

[21]  Ashutosh Saxena,et al.  Learning Depth from Single Monocular Images , 2005, NIPS.

[22]  Jianliang Tang,et al.  Complete Solution Classification for the Perspective-Three-Point Problem , 2003, IEEE Trans. Pattern Anal. Mach. Intell..

[23]  Thomas Luhmann,et al.  Eccentricity in Images of Circular and Spherical Targets and its Impact to 3D Object Reconstruction , 2014 .

[24]  T. Luhmann Eccentricity in images of circular and spherical targets and its impact on spatial intersection , 2014 .

[25]  Reinhard Klette,et al.  Geometric Correction of Projected Rectangular Pictures , 2005 .

[26]  D. C. Brown,et al.  Lens distortion for close-range photogrammetry , 1986 .

[27]  M. de Mathelin,et al.  Evaluation of an image-based tracking workflow using a passive marker and resonant micro-coil fiducials for automatic image plane alignment in interventional MRI , 2012, 2012 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[28]  Wenhan Yang,et al.  Perspective distorted video restoration and stabilization for mobile devices , 2015, 2015 IEEE China Summit and International Conference on Signal and Information Processing (ChinaSIP).

[29]  Chew Lim Tan,et al.  Character Recognition under Severe Perspective Distortion , 2008, 2009 10th International Conference on Document Analysis and Recognition.

[30]  Ian D. Reid,et al.  Learning Depth from Single Monocular Images Using Deep Convolutional Neural Fields , 2015, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[31]  Salvatore Tabbone,et al.  Camera-captured document image perspective distortion correction using vanishing point detection based on Radon transform , 2016, 2016 23rd International Conference on Pattern Recognition (ICPR).

[32]  Giuseppe Valenzise,et al.  Learning Local Distortion Visibility from Image Quality , 2018, 2018 25th IEEE International Conference on Image Processing (ICIP).