A new system to acquire and restore document shape and content

We have developed a system that can acquire and restore not only a distorted single-page document, but also more complicated multilayer film negatives. In this work, we demonstrate a new image-based document acquisition system, based on single-scatter diffuse transmission, that captures the intrinsic intensity information and shape distortion of documents. Using a simple to build and costeffective camera and LCD system, the data is acquired to allow for automatic photometric and geometric correction of most documents. We show the results of our system with single sheet nonplanar documents. Furthermore, to show the robustness of this system, we demonstrate the restoration on safety acetate film negatives over 70 years old that have been damaged due to shrinkage and other forms of deterioration.

[1]  Changsong Liu,et al.  A cylindrical surface model to rectify the bound document image , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[2]  Michael S. Brown,et al.  Geometric and shading correction for images of printed materials using boundary , 2006, IEEE Transactions on Image Processing.

[3]  Guillermo Sapiro,et al.  Simultaneous structure and texture image inpainting , 2003, IEEE Trans. Image Process..

[4]  David Salesin,et al.  Environment matting extensions: towards higher accuracy and real-time capture , 2000, SIGGRAPH.

[5]  Baining Guo,et al.  Real-time rendering of plant leaves , 2005, SIGGRAPH 2005.

[6]  Yu Zhang,et al.  Ieee Transactions on Pattern Analysis and Machine Intelligence 1 an Improved Physically-based Method for Geometric Restoration of Distorted Document Images , 2007 .

[7]  Rafael C. González,et al.  Local Determination of a Moving Contrast Edge , 1985, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[8]  G. Rybicki.  Radiative transfer , 2019, Climate Change and Terrestrial Ecosystem Modeling.

[9]  W. Brent Seales,et al.  Geometric and photometric restoration of distorted documents , 2005, Tenth IEEE International Conference on Computer Vision (ICCV'05) Volume 1.

[10]  Edoardo Ardizzone,et al.  Damages of digitized historical images as objects for content based applications , 2006, 2006 14th European Signal Processing Conference.

[11]  W. Brent Seales,et al.  Digital restoration using volumetric scanning , 2004, JCDL.

[12]  G. Ramponi,et al.  Towards the automated restoration of old photographic prints: a survey , 2003, The IEEE Region 8 EUROCON 2003. Computer as a Tool..

[13]  Jeppe Revall Frisvad,et al.  Efficient light scattering through thin semi-transparent objects , 2005, GRAPHITE '05.

[14]  Jitendra Malik,et al.  Recovering high dynamic range radiance maps from photographs , 1997, SIGGRAPH.

[15]  Anil C. Kokaram,et al.  Digital Removal of Blotches with Variable Semi-transparency Using Visibility Laws , 2007, BVAI.

[16]  Guillermo Sapiro,et al.  Image inpainting , 2000, SIGGRAPH.

[17]  Shree K. Nayar,et al.  What does motion reveal about transparency? , 2003, Proceedings Ninth IEEE International Conference on Computer Vision.

[18]  Richard Szeliski,et al.  Layer extraction from multiple images containing reflections and transparency , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[19]  David J. Kriegman,et al.  The Bas-Relief Ambiguity , 2004, International Journal of Computer Vision.

[20]  Rama Chellappa,et al.  A Method for Enforcing Integrability in Shape from Shading Algorithms , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  W. Brent Seales,et al.  Image restoration of arbitrarily warped documents , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[22]  G. Ramponi,et al.  Virtual restoration of fragmented glass plate photographs , 2004, Proceedings of the 12th IEEE Mediterranean Electrotechnical Conference (IEEE Cat. No.04CH37521).

[23]  Berthold K. P. Horn.  SHAPE FROM SHADING: A METHOD FOR OBTAINING THE SHAPE OF A SMOOTH OPAQUE OBJECT FROM ONE VIEW , 1970 .

[24]  S. Ustin,et al.  Three-dimensional radiation transfer modeling in a dicotyledon leaf. , 1996, Applied optics.

[25]  Kiriakos N. Kutulakos,et al.  Reconstructing the Surface of Inhomogeneous Transparent Scenes by Scatter-Trace Photography , 2007, 2007 IEEE 11th International Conference on Computer Vision.

[26]  Michael J. Black,et al.  Fields of Experts: a framework for learning image priors , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[27]  David Salesin,et al.  Environment matting and compositing , 1999, SIGGRAPH.

[28]  Patrick Pérez,et al.  Region filling and object removal by exemplar-based image inpainting , 2004, IEEE Transactions on Image Processing.

[29]  L. Johnson,et al.  LEAFMOD : A new within-leaf radiative transfer model , 1998 .

[30]  W. Brent Seales,et al.  Towards Automatic Photometric Correction of Casually Illuminated Documents , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.