Visual tunnel analysis for visibility prediction and camera planning

A sequence of images taken along a camera trajectory captures a subset of scene appearance. If visibility space is the space that encapsulates the appearance of the scene at every conceivable pose and viewing angle, then the act of acquiring the image sequence constitutes "carving a volume in visibility space." We call such a volume a visual tunnel. The analysis of the visual tunnel allows us to do the following: predict the range of virtual camera poses in which the images can be reconstructed totally using the captured rays, predict which parts of the image can be generated for a given virtual camera pose, and plan camera paths for scene visualization at desired locations. We describe our visual tunnel concept and provide illustrative examples in 2D and 3D.

[1]  Václav Hlavác,et al.  Automatic Selection of Reference Views for Image-Based Scene Representations , 1996, ECCV.

[2]  C. Hansen,et al.  Parallel lumigraph reconstruction , 1999, Proceedings 1999 IEEE Parallel Visualization and Graphics Symposium (Cat. No.99EX381).

[3]  Sing Bing Kang,et al.  Survey of image-based rendering techniques , 1998, Electronic Imaging.

[4]  Amnon Shashua,et al.  Novel view synthesis in tensor space , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[5]  A. Laurentini,et al.  The Visual Hull Concept for Silhouette-Based Image Understanding , 1994, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Steven M. Seitz,et al.  View morphing , 1996, SIGGRAPH.

[7]  Ruzena Bajcsy,et al.  Occlusions as a Guide for Planning the Next View , 1993, IEEE Trans. Pattern Anal. Mach. Intell..

[8]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[9]  Peter Kovesi,et al.  Automatic Sensor Placement from Vision Task Requirements , 1988, IEEE Trans. Pattern Anal. Mach. Intell..

[10]  Lance Williams,et al.  View Interpolation for Image Synthesis , 1993, SIGGRAPH.

[11]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[12]  Hans-Peter Seidel,et al.  Adaptive Acquisition of Lumigraphs from Synthetic Scenes , 1999, Comput. Graph. Forum.

[13]  Wolfgang Stuerzlinger,et al.  Imaging all Visible Surfaces , 1999, Graphics Interface.

[14]  Donald P. Greenberg,et al.  The Irradiance Volume , 1998, IEEE Computer Graphics and Applications.

[15]  Richard Szeliski,et al.  Prediction error as a quality metric for motion and stereo , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[16]  E. Adelson,et al.  The Plenoptic Function and the Elements of Early Vision , 1991 .

[17]  Harry Shum,et al.  Rendering with concentric mosaics , 1999, SIGGRAPH.