Camera-captured document image perspective distortion correction using vanishing point detection based on Radon transform

A correction method for perspective distortions on document images is discussed. In documents, lines and line feeds give rise to many horizontal and vertical lines, then two vanishing points generated by these lines can be computed. High-energy regions are identified in the Radon transform thanks to a binarization step. Then, the image is zero-padded and the inverse Radon transform is applied to underline the main lines direction in the original image. The distortion is corrected by the perspective mapping determined with the two vanishing points and we propose to compute the homography matrix for the perspective mapping. Experimental results show that our method can correct the perspective distortions effectively and outperforms the state-of-the-art for vanishing points detection accuracy.

[1]  David S. Doermann,et al.  Geometric Rectification of Camera-Captured Document Images , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[2]  Carsten Rother A new approach to vanishing point detection in architectural environments , 2002, Image Vis. Comput..

[3]  Shinichiro Omachi,et al.  Affine Invariant Recognition of Characters by Progressive Pruning , 2008, 2008 The Eighth IAPR International Workshop on Document Analysis Systems.

[4]  Salvatore Tabbone,et al.  Amplitude-only log Radon transform for geometric invariant shape descriptor , 2014, Pattern Recognit..

[5]  Maher A. Sid-Ahmed,et al.  Skew detection and correction based on an axes-parallel bounding box , 2014, International Journal on Document Analysis and Recognition (IJDAR).

[6]  Shijian Lu,et al.  Perspective rectification of document images using fuzzy set and morphological operations , 2005, Image Vis. Comput..

[7]  Chew Lim Tan,et al.  Restoring Warped Document Images through 3D Shape Modeling , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Salvatore Tabbone,et al.  Histogram of Radon transform with angle correlation matrix for distortion invariant shape descriptor , 2016, Neurocomputing.

[9]  Jean Ponce,et al.  Vanishing point detection for road detection , 2009, CVPR.

[10]  Jean-Michel Morel,et al.  ASIFT: A New Framework for Fully Affine Invariant Image Comparison , 2009, SIAM J. Imaging Sci..

[11]  Hui Ren,et al.  A New Vanishing Point Detection Algorithm Based on Hough Transform , 2010, 2010 Third International Joint Conference on Computational Science and Optimization.

[12]  Anthony Hoogs,et al.  A Minimum Error Vanishing Point Detection Approach for Uncalibrated Monocular Images of Man-Made Environments , 2013, 2013 IEEE Conference on Computer Vision and Pattern Recognition.

[13]  S. Deans The Radon Transform and Some of Its Applications , 1983 .

[14]  Yu Zhang,et al.  Restoring camera-captured distorted document images , 2014, International Journal on Document Analysis and Recognition (IJDAR).

[15]  Roberto Manduchi,et al.  Towards Mobile OCR: How to Take a Good Picture of a Document Without Sight , 2015, DocEng.