Active Rectification of Curved Document Images Using Structured Beams

We propose an active method to rectify the geometric and photometric distortions in a document image. This method uses structured beams projected upon the curved document page to recover the spatial curves on it. A developable surface is interpolated to the curves by finding the correspondence between them. To correct the geometric distortion, the estimated developable surface is finally flattened onto a plane by explicitly solving a system of ordinary differential equations. The recovered 3D page shape, together with a Lambertian illumination model as guidance, is further used to rectify the non-uniform illumination in the images. Experimental results based on a variety of synthetic and real-captured document images demonstrate the effectiveness and efficiency of the proposed method.

[1]  Jiang Yong,et al.  Text line extraction from multi-skewed handwritten documents , 2008, 2008 27th Chinese Control Conference.

[2]  Alan C. Evans,et al.  3-D Brain MRI Tissue Classification on FPGAs , 2009, IEEE Transactions on Image Processing.

[3]  Shree K. Nayar,et al.  High dynamic range imaging: spatially varying pixel exposures , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[4]  Syed Saqib Bukhari,et al.  Textline information extraction from grayscale camera-captured document images , 2009, 2009 16th IEEE International Conference on Image Processing (ICIP).

[5]  Michael S. Brown,et al.  Geometric and shading correction for images of printed materials using boundary , 2006, IEEE Transactions on Image Processing.

[6]  Edsger W. Dijkstra,et al.  A note on two problems in connexion with graphs , 1959, Numerische Mathematik.

[7]  Larry S. Davis,et al.  3D Structure Recovery and Unwarping of Surfaces Applicable to Planes , 2006, International Journal of Computer Vision.

[8]  Gaofeng Meng,et al.  Metric Rectification of Curved Document Images , 2012, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[9]  Christoph H. Lampert,et al.  Document image dewarping using robust estimation of curled text lines , 2005, Eighth International Conference on Document Analysis and Recognition (ICDAR'05).

[10]  Ming-Huei Chen,et al.  A cost-effective line-based light-balancing technique using adaptive processing , 2006, IEEE Transactions on Image Processing.

[11]  David S. Doermann,et al.  Camera-based analysis of text and documents: a survey , 2005, International Journal of Document Analysis and Recognition (IJDAR).

[12]  W. B. Seales,et al.  Restoring 2D Content from Distorted Documents , 2007, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[13]  Jian Fan,et al.  Robust Color Image Enhancement of Digitized Books , 2009, 2009 10th International Conference on Document Analysis and Recognition.

[14]  A. Bartoli,et al.  A Computational Model of Bounded Developable Surfaces with Application to Image-Based 3D Reconstruction , 2012 .

[15]  W. Brent Seales,et al.  Document restoration using 3D shape: a general deskewing algorithm for arbitrarily warped documents , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[16]  Surendar Chandra,et al.  Dewarping Book Page Spreads Captured with a Mobile Phone Camera , 2013, CBDAR.

[17]  David S. Doermann,et al.  Progress in camera-based document image analysis , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[18]  Shijian Lu,et al.  A partition approach for the restoration of camera images of planar and curled document , 2006, Image Vis. Comput..

[19]  Jeanny Hérault,et al.  Curvilinear component analysis: a self-organizing neural network for nonlinear mapping of data sets , 1997, IEEE Trans. Neural Networks.

[20]  Christoph H. Lampert,et al.  Document capture using stereo vision , 2004, DocEng '04.

[21]  Mathieu Perriollat,et al.  A computational model of bounded developable surfaces with application to image‐based three‐dimensional reconstruction , 2013, Comput. Animat. Virtual Worlds.

[22]  Michael S. Brown,et al.  Conformal deskewing of non-planar documents , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[23]  James F. Blinn,et al.  Models of light reflection for computer synthesized pictures , 1977, SIGGRAPH.

[24]  Ioannis Pratikakis,et al.  Goal-Oriented Rectification of Camera-Based Document Images , 2011, IEEE Transactions on Image Processing.

[25]  Nanning Zheng,et al.  Nonparametric Illumination Correction for Scanned Document Images via Convex Hulls , 2013, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[26]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[27]  Adrien Bartoli,et al.  Generalized Thin-Plate Spline Warps , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[28]  Takashi Matsuyama,et al.  Shape from Shading with Interreflections Under a Proximal Light Source: Distortion-Free Copying of an Unfolded Book , 1997, International Journal of Computer Vision.

[29]  Øivind Due Trier,et al.  Evaluation of Binarization Methods for Document Images , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[30]  Michael S. Brown,et al.  A unified framework for document restoration using inpainting and shape-from-shading , 2009, Pattern Recognit..

[31]  David S. Doermann,et al.  Flattening curved documents in images , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[32]  Bui Tuong Phong Illumination for computer generated pictures , 1975, Commun. ACM.

[33]  Changsong Liu,et al.  A cylindrical surface model to rectify the bound document image , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[34]  Robert L. Cook,et al.  A Reflectance Model for Computer Graphics , 1987, TOGS.

[35]  Michael S. Brown,et al.  Geometric and shading correction for images of printed materials: a unified approach using boundary , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[36]  Nam Ik Cho,et al.  State Estimation in a Document Image and Its Application in Text Block Identification and Text Line Extraction , 2010, ECCV.

[37]  Chew Lim Tan,et al.  Restoration of curved document images through 3D shape modeling , 2004, Proceedings of the 2004 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2004. CVPR 2004..

[38]  Raúl Rojas,et al.  Robust Document Warping with Interpolated Vector Fields , 2007, Ninth International Conference on Document Analysis and Recognition (ICDAR 2007).

[39]  Ioannis Pratikakis,et al.  Adaptive degraded document image binarization , 2006, Pattern Recognit..

[40]  David S. Doermann,et al.  Geometric Rectification of Camera-Captured Document Images , 2008, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[41]  Andy M. Yip,et al.  A Restoration Framework for Correcting Photometric and Geometric Distortions in Camera-based Document Images , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[42]  Yuan He,et al.  A Book Dewarping System by Boundary-Based 3D Surface Reconstruction , 2013, 2013 12th International Conference on Document Analysis and Recognition.

[43]  Maurizio Pilu,et al.  Undoing page curl distortion using applicable surfaces , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[44]  Larry S. Davis,et al.  Structure of Applicable Surfaces from Single Views , 2004, ECCV.

[45]  Yu Zhang,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 an Improved Physically-based Method for Geometric Restoration of Distorted Document Images , 2007 .

[46]  Maurizio Pilu Undoing paper curl distortion using applicable surfaces , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[47]  Raúl Rojas,et al.  Robust Document Warping with Interpolated Vector Fields , 2007 .

[48]  Nam Ik Cho,et al.  Composition of a Dewarped and Enhanced Document Image From Two View Images , 2009, IEEE Transactions on Image Processing.

[49]  Gaofeng Meng,et al.  Active Flattening of Curved Document Images via Two Structured Beams , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[50]  Chew Lim Tan,et al.  Straightening warped text lines using polynomial regression , 2002, Proceedings. International Conference on Image Processing.

[51]  Michael S. Brown,et al.  Multi-View Document Rectification using Boundary , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[52]  Yuandong Tian,et al.  Rectification and 3D reconstruction of curved document images , 2011, CVPR 2011.

[53]  Masatoshi Ishikawa,et al.  Digitization of Deformed Documents Using a High-Speed Multi-camera Array , 2012, ACCV.

[54]  W. Brent Seales,et al.  Image restoration of arbitrarily warped documents , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[55]  Meng Sun,et al.  A Technique for Constructing Developable Surfaces , 1996, Graphics Interface.

[56]  Chew Lim Tan,et al.  Restoring Warped Document Images through 3D Shape Modeling , 2006, IEEE Trans. Pattern Anal. Mach. Intell..

[57]  Chew Lim Tan,et al.  Correcting document image warping based on regression of curved text lines , 2003, Seventh International Conference on Document Analysis and Recognition, 2003. Proceedings..

[58]  Chin-Chen Chang,et al.  A Novel Illumination-Balance Technique for Improving the Quality of Degraded Text-Photo Images , 2009, IEEE Transactions on Circuits and Systems for Video Technology.