Camera and projector arrays for immersive 3D video

Applying recent advances in multi-imager capture and multi-projector display, we combine capabilities through the Nizza multimedia dataflow architecture to deliver low-cost wide-VGA-quality low-latency autostereoscopic 3D display of live video on a single PC. Supporting multiple users as they observe and interact against a life-sized display surface responsive to their positions, this facility will open new opportunities in mediated interaction.

[1]  Robert C. Bolles,et al.  Generalizing Epipolar-Plane Image Analysis on the spatiotemporal surface , 2004, International Journal of Computer Vision.

[2]  John F. Canny,et al.  MultiView: spatially faithful group video conferencing , 2005, CHI.

[3]  Wojciech Matusik,et al.  3D TV: a scalable system for real-time acquisition, transmission, and autostereoscopic display of dynamic scenes , 2004, ACM Trans. Graph..

[4]  Thomas Malzbender,et al.  Understanding performance in coliseum, an immersive videoconferencing system , 2005, TOMCCAP.

[5]  Bernhard P. Wrobel,et al.  Multiple View Geometry in Computer Vision , 2001 .

[6]  Dan Gelb,et al.  Nizza: A Framework for Developing Real-time Streaming Multimedia Applications , 2004 .

[7]  F. Russo,et al.  An image enhancement technique combining sharpening and noise reduction , 2001, IMTC 2001. Proceedings of the 18th IEEE Instrumentation and Measurement Technology Conference. Rediscovering Measurement in the Age of Informatics (Cat. No.01CH 37188).

[8]  Marc Levoy,et al.  High-speed videography using a dense camera array , 2004, CVPR 2004.

[9]  Zhengyou Zhang,et al.  Flexible camera calibration by viewing a plane from unknown orientations , 1999, Proceedings of the Seventh IEEE International Conference on Computer Vision.

[10]  Michael Harville,et al.  Practical Methods for Geometric and Photometric Correction of Tiled Projector , 2006, 2006 Conference on Computer Vision and Pattern Recognition Workshop (CVPRW'06).

[11]  Niranjan Damera-Venkata,et al.  Realizing Super-Resolution with Superimposed Projection , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Andrew Zisserman,et al.  Multiple view geometry in computer visiond , 2001 .

[13]  H. Harlyn Baker,et al.  A Multi-imager Camera for Variable-Definition Video (XDTV) , 2006, MRCS.