Image interpolation by joint view triangulation

Creating novel views by interpolating prestored images or view morphing has many applications in visual simulation. We present in this paper a new method of automatically interpolating two images which tackles two most difficult problems of morphing due to the lack of depth informational pixel matching and visibility handling. We first describe a quasi-dense matching algorithm based on region growing with the best first strategy for match propagation. Then, we describe a robust construction of matched planar patches using local geometric constraints encoded by a homography. After that we introduce a novel representation, joint view triangulation, for visible and half-occluded patches in two images to handle their visibility during the creation of new view. Finally we demonstrate these techniques on real image pairs.

[1]  Amnon Shashua,et al.  Novel view synthesis in tensor space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[2]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[3]  Andreas Koschan,et al.  What is New in Computational Stereo Since 1989: A Survey on Current Stereo Papers , 1993 .

[4]  M. Lhuillier.  Towards Automatic Interpolation for Real and Distant Image Pairs , 1999 .

[5]  Thaddeus Beier,et al.  Feature-based image metamorphosis , 1992, SIGGRAPH.

[6]  Rachid Deriche,et al.  A Robust Technique for Matching two Uncalibrated Images Through the Recovery of the Unknown Epipolar Geometry , 1995, Artif. Intell..

[7]  Olivier D. Faugeras,et al.  3-D scene representation as a collection of images , 1994, Proceedings of 12th International Conference on Pattern Recognition.

[8]  Linda G. Shapiro,et al.  Image Segmentation Techniques , 1984, Other Conferences.

[9]  Steven M. Seitz,et al.  Physically-valid view synthesis by image interpolation , 1995, Proceedings IEEE Workshop on Representation of Visual Scenes (In Conjunction with ICCV'95).

[10]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[11]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[12]  Andrew Zisserman,et al.  Robust parameterization and computation of the trifocal tensor , 1997, Image Vis. Comput..

[13]  George Drettakis,et al.  Efficient Impostor Manipulation for Real‐Time Visualization of Urban Scenery , 1997, Comput. Graph. Forum.

[14]  George Wolberg,et al.  Digital image warping , 1990 .

[15]  Marc Levoy,et al.  Zippered polygon meshes from range images , 1994, SIGGRAPH.

[16]  Thomas Ertl,et al.  Computer Graphics - Principles and Practice, 3rd Edition , 2014 .

[17]  M. Carter.  Computer graphics: Principles and practice , 1997 .

[18]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[19]  Carlo Tomasi,et al.  Good features to track , 1994, 1994 Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.

[20]  Samuel Rippa,et al.  Minimal roughness property of the Delaunay triangulation , 1990, Comput. Aided Geom. Des..

[21]  Denis Laurendeau,et al.  A General Surface Approach to the Integration of a Set of Range Views , 1995, IEEE Trans. Pattern Anal. Mach. Intell..

[22]  Chuck Hansen,et al.  Eurographics '97 , 1998, COMG.

[23]  Michael Ian Shamos,et al.  Computational geometry: an introduction , 1985 .

[24]  Shenchang Eric Chen,et al.  QuickTime VR: an image-based approach to virtual environment navigation , 1995, SIGGRAPH.

[25]  Sung Yong Shin,et al.  Image Morphing Using Deformation Techniques , 1996, Comput. Animat. Virtual Worlds.

[26]  G. P. Otto,et al.  "Region-growing" algorithm for matching of terrain images , 1989, Image Vis. Comput..

[27]  Jake K. Aggarwal,et al.  Structure from stereo-a review , 1989, IEEE Trans. Syst. Man Cybern..

[28]  Steve Hollasch,et al.  Advanced animation and rendering techniques , 1994, Comput. Graph..

[29]  Christopher G. Harris,et al.  A Combined Corner and Edge Detector , 1988, Alvey Vision Conference.

[30]  Takeo Kanade,et al.  An Iterative Image Registration Technique with an Application to Stereo Vision , 1981, IJCAI.