Model Driven Compression of 3-D Tele-Immersion Data

Due to technology advances, reconstructing threedimensional representations of physical environments in real time using cheap and non-professional cameras and PCs becomes possible. These advances will make 3D tele-immersive environments available for everyone in the near future. However, the data captured by a TeleImmersion (TI) system can be very large. Compression is needed to ensure real-time transmission of the data. Due to this real-time requirement, compressing TI data can be a challenging task and no current techniques can effectively address this issue. In this paper, we propose a model driven compression. The main idea of this approach is to take advantage of prior knowledge of objects, e.g., human figures, in the physical environments and to represent their motions using just a few parameters. The proposed compression method provides tunable and high compression ratios (from 50:1 to 5000:1) with reasonable reconstruction quality. Moreover, the proposed method can estimate motions from the noisy data captured by our TI system in real time.

[1]  Okan Arikan.  Compression of motion capture databases , 2006, SIGGRAPH 2006.

[2]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[3]  Dietmar Saupe,et al.  Compression of Point-Based 3D Models by Shape-Adaptive Wavelet Coding of Multi-Height Fields , 2004, PBG.

[4]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.

[5]  Takeo Kanade,et al.  Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[6]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[7]  Ruzena Bajcsy,et al.  TEEVE: the next generation architecture for tele-immersive environments , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[8]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[9]  Ketan Mayer-Patel,et al.  Real-time multidepth stream compression , 2005, TOMCCAP.

[10]  Hans-Peter Seidel,et al.  Predictive point-cloud compression , 2005, SIGGRAPH '05.

[11]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[12]  Trevor Darrell,et al.  3-D articulated pose tracking for untethered diectic reference , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[13]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[14]  Y. Aloimonos,et al.  Discovering a Language for Human Activity 1 , 2005 .

[15]  Yiannis Aloimonos,et al.  Human Activity Language: Grounding Concepts with a Linguistic Framework , 2006, SAMT.

[16]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[17]  Rüdiger Dillmann,et al.  Sensor fusion for 3D human body tracking with an articulated 3D body model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[18]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[19]  William Yurcik,et al.  Real-time 3D video compression for tele-immersive environments , 2006, Electronic Imaging.

[20]  Trevor Darrell,et al.  Stereo tracking using ICP and normal flow constraint , 2002, Object recognition supported by user interaction for service robots.

[21]  Radu Horaud,et al.  Hand Motion from 3D Point Trajectories and a Smooth Surface Model , 2004, ECCV.

[22]  Ruzena Bajcsy,et al.  Real-Time 3D-Teleimmersion , 2000, Confluence of Computer Vision and Computer Graphics.

[23]  Takeo Kanade,et al.  Real-time 3-D pose estimation using a high-speed range sensor , 1993, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[24]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[25]  Jinghua Zhang,et al.  Octree-based animated geometry compression , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.