3D Structure Recovery and Unwarping of Surfaces Applicable to Planes

Abstract.The deformation of applicable surfaces such as sheets of paper satisfies the differential geometric constraints of isometry (lengths and areas are conserved) and vanishing Gaussian curvature. We show that these constraints lead to a closed set of equations that allow recovery of the full geometric structure from a single image of the surface and knowledge of its undeformed shape. We show that these partial differential equations can be reduced to the Hopf equation that arises in non-linear wave propagation, and deformations of the paper can be interpreted in terms of the characteristics of this equation. A new exact integration of these equations is developed that relates the 3-D structure of the applicable surface to an image. The solution is tested by comparison with particular exact solutions. We present results for both the forward and the inverse 3D structure recovery problem.

[1]  Jiann-Der Lee,et al.  Determining location and orientation of a labelled cylinder using point-pair estimation algorithm , 1992, [1992] Proceedings. 11th IAPR International Conference on Pattern Recognition.

[2]  H. Piaggio.  Differential Geometry of Curves and Surfaces , 1952, Nature.

[3]  O. Faugeras.  Three-dimensional computer vision: a geometric viewpoint , 1993 .

[4]  Demetri Terzopoulos,et al.  Deformable models in medical image analysis: a survey , 1996, Medical Image Anal..

[5]  Olivier Faugeras,et al.  Three-Dimensional Computer Vision , 1993 .

[6]  Majid Mirmehdi,et al.  Estimating the Orientation and Recovery of Text Planes in a Single Image , 2001, BMVC.

[7]  Larry S. Davis,et al.  A video based interface to textual information for the visually impaired , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[8]  Manfredo P. do Carmo,et al.  Differential geometry of curves and surfaces , 1976 .

[9]  Maurizio Pilu,et al.  Undoing page curl distortion using applicable surfaces , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[10]  William H. Press,et al.  Numerical recipes in C , 2002 .

[11]  W. Brent Seales,et al.  Document restoration using 3D shape: a general deskewing algorithm for arbitrarily warped documents , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[12]  J J Koenderink,et al.  What Does the Occluding Contour Tell Us about Solid Shape? , 1984, Perception.

[13]  Michael A. Penna,et al.  Non-rigid motion analysis: Isometric motion , 1992, CVGIP Image Underst..

[14]  Larry S. Davis,et al.  Structure of Applicable Surfaces from Single Views , 2004, ECCV.

[15]  JIANN-DER LEE,et al.  Determining Location and Orientation of A Labelled Cylinder Using Point-Pair Estimation Algorithm , 1994, Int. J. Pattern Recognit. Artif. Intell..

[16]  Andrew Zisserman,et al.  Metric rectification for perspective images of planes , 1998, Proceedings. 1998 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (Cat. No.98CB36231).

[17]  Jan J. Koenderink,et al.  Solid shape , 1990 .

[18]  Andrew Zisserman,et al.  Detecting and Tracking Linear Features Efficiently , 1996, BMVC.

[19]  A. Gray,et al.  Modern Differential Geometry of Curves and Surfaces with Mathematica, Third Edition (Studies in Advanced Mathematics) , 2006 .

[20]  L. Chambers.  Linear and Nonlinear Waves , 2000, The Mathematical Gazette.

[21]  Majid Mirmehdi,et al.  Recognising text in real scenes , 2002, International Journal on Document Analysis and Recognition.

[22]  Yuan-Fang Wang,et al.  Computation of Surface Orientation and Structure of Objects Using Grid Coding , 1987, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[23]  Robert M. Haralick,et al.  Nonlinear global and local document degradation models , 1994, Int. J. Imaging Syst. Technol..

[24]  Alfred Gray,et al.  Modern differential geometry of curves and surfaces with Mathematica (2. ed.) , 1998 .

[25]  Jean Ponce,et al.  Computer Vision: A Modern Approach , 2002 .

[26]  Maurizio Pilu,et al.  Extraction of illusory linear clues in perspectively skewed documents , 2001, Proceedings of the 2001 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. CVPR 2001.

[27]  Granino A. Korn,et al.  Mathematical handbook for scientists and engineers , 1961 .

[28]  Alan M. McIvor.  Robust 3 D Surface Property , 1995 .

[29]  Tosiyasu L. Kunii,et al.  Bending and creasing virtual paper , 1994, IEEE Computer Graphics and Applications.

[30]  Cleve Moler,et al.  Mathematical Handbook for Scientists and Engineers , 1961 .