The graph camera

A conventional pinhole camera captures only a small fraction of a 3-D scene due to occlusions. We introduce the graph camera, a non-pinhole with rays that circumvent occluders to create a single layer image that shows simultaneously several regions of interest in a 3-D scene. The graph camera image exhibits good continuity and little redundancy. The graph camera model is literally a graph of tens of planar pinhole cameras. A fast projection operation allows rendering in feed-forward fashion, at interactive rates, which provides support for dynamic scenes. The graph camera is an infrastructure level tool with many applications. We explore the graph camera benefits in the contexts of virtual 3-D scene exploration and summarization, and in the context of real-world 3-D scene visualization. The graph camera allows integrating multiple video feeds seamlessly, which enables monitoring complex real-world spaces with a single image.

[1]  Leonard McMillan,et al.  Plenoptic Modeling: An Image-Based Rendering System , 2023 .

[2]  Voicu Popescu,et al.  The Occlusion Camera , 2005, Comput. Graph. Forum.

[3]  Richard Szeliski,et al.  Creating full view panoramic image mosaics and texture-mapped models , 1997, International Conference on Computer Graphics and Interactive Techniques.

[4]  Shree K. Nayar,et al.  Scene Collages and Flexible Camera Arrays , 2007, Rendering Techniques.

[5]  M. Sheelagh T. Carpendale,et al.  Edgelens: an interactive method for managing edge congestion in graphs , 2003, IEEE Symposium on Information Visualization 2003 (IEEE Cat. No.03TH8714).

[6]  Niklas Elmqvist,et al.  BalloonProbe: reducing occlusion in 3D using interactive space distortion , 2005, VRST '05.

[7]  Steven M. Seitz,et al.  Multiperspective Imaging , 2003, IEEE Computer Graphics and Applications.

[8]  Leonard McMillan,et al.  Modelling reflections via multiperspective imaging , 2005, 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05).

[9]  Shree K. Nayar,et al.  A general imaging model and a method for finding its parameters , 2001, Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001.

[10]  Voicu Popescu,et al.  The depth discontinuity occlusion camera , 2006, I3D '06.

[11]  Adam Finkelstein,et al.  Stylized video cubes , 2002, SCA '02.

[12]  Thomas Ertl,et al.  Transparency in Interactive Technical Illustrations , 2002, Comput. Graph. Forum.

[13]  Michael Bosse,et al.  Unstructured lumigraph rendering , 2001, SIGGRAPH.

[14]  David Salesin,et al.  Surface light fields for 3D photography , 2000, SIGGRAPH.

[15]  Leonard McMillan,et al.  A Framework for Multiperspective Rendering , 2004, Rendering Techniques.

[16]  Hendrik P. A. Lensch,et al.  Automatic multiperspective images , 2006, EGSR '06.

[17]  Luc Van Gool,et al.  European conference on computer vision (ECCV) , 2006, eccv 2006.

[18]  Voicu Popescu,et al.  Sample-Based Cameras for Feed Forward Reflection Rendering , 2006, IEEE Transactions on Visualization and Computer Graphics.

[19]  G. W. Furnas,et al.  Generalized fisheye views , 1986, CHI '86.

[20]  David Salesin,et al.  Photographing long scenes with multi-viewpoint panoramas , 2006, ACM Trans. Graph..

[21]  Marc Levoy,et al.  Interactive design of multi-perspective images for visualizing urban landscapes , 2004, IEEE Visualization 2004.

[22]  Rajiv Gupta,et al.  Linear Pushbroom Cameras , 1994, ECCV.

[23]  Paul Rademacher,et al.  Multiple-center-of-projection images , 1998, SIGGRAPH.

[24]  Marc Levoy,et al.  Light field rendering , 1996, SIGGRAPH.

[25]  David Salesin,et al.  Multiperspective panoramas for cel animation , 1997, SIGGRAPH.

[26]  Leonard McMillan,et al.  General Linear Cameras , 2004, ECCV.

[27]  Maneesh Agrawala,et al.  Artistic Multiprojection Rendering , 2000, Rendering Techniques.

[28]  Richard Szeliski,et al.  Layered depth images , 1998, SIGGRAPH.

[29]  Voicu Popescu,et al.  The epipolar occlusion camera , 2008, I3D '08.

[30]  John Hart,et al.  ACM Transactions on Graphics , 2004, SIGGRAPH 2004.

[31]  Shree K. Nayar,et al.  Multiview radial catadioptric imaging for scene capture , 2006, ACM Trans. Graph..

[32]  Richard Szeliski,et al.  The lumigraph , 1996, SIGGRAPH.

[33]  Jean Ponce,et al.  What is a camera? , 2009, 2009 IEEE Conference on Computer Vision and Pattern Recognition.

[34]  D. Rogers,et al.  Prism: a multi-view visualization tool for multi-physics simulation , 2005, Coordinated and Multiple Views in Exploratory Visualization (CMV'05).

[35]  Ramana Rao,et al.  The Hyperbolic Browser: A Focus + Context Technique for Visualizing Large Hierarchies , 1996, J. Vis. Lang. Comput..