Skeleton-Based Compression of 3-D Tele-Immersion Data

Due to technology advances, reconstructing three-dimensional representations of physical environments in real time using cheap and non-professional cameras and PCs becomes possible. These advances will make 3-D tele-immersive environments available for everyone in the near future. However, the amount of data captured, by a Tele-Immersion (TI) system can be very large. Compression is needed to ensure real-time transmission of the data. Due to this real-time requirement, compressing TI data can be a challenging task and no current techniques can effectively address this issue. In this paper, we propose a skeleton-based compression. The main idea of this approach is to take advantage of prior knowledge of objects, e.g., human figures, in the physical environments and to represent their motions using just a few parameters. The proposed compression method provides tunable and high compression ratios (from 50:1 to 5000:1) with reasonable reconstruction quality, Moreover, the proposed method can estimate motions from the noisy data captured by our TI system in real time.

[1]  Jon Louis Bentley,et al.  Multidimensional binary search trees used for associative searching , 1975, CACM.

[2]  Paul J. Besl,et al.  A Method for Registration of 3-D Shapes , 1992, IEEE Trans. Pattern Anal. Mach. Intell..

[3]  Takeo Kanade,et al.  Real-time 3-D pose estimation using a high-speed range sensor , 1993, Proceedings of the 1994 IEEE International Conference on Robotics and Automation.

[4]  Jed Lengyel,et al.  Compression of time-dependent geometry , 1999, SI3D.

[5]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[6]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[7]  Ruzena Bajcsy,et al.  Real-Time 3D-Teleimmersion , 2000, Confluence of Computer Vision and Computer Graphics.

[8]  Real-time 3d-tele-immersion , 2000 .

[9]  Marc Alexa,et al.  Representing Animations by Principal Components , 2000, Comput. Graph. Forum.

[10]  Marc Levoy,et al.  Efficient variants of the ICP algorithm , 2001, Proceedings Third International Conference on 3-D Digital Imaging and Modeling.

[11]  Trevor Darrell,et al.  3-D articulated pose tracking for untethered diectic reference , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[12]  Trevor Darrell,et al.  Stereo tracking using ICP and normal flow constraint , 2002, Object recognition supported by user interaction for service robots.

[13]  Takeo Kanade,et al.  Shape-from-silhouette of articulated objects and its use for human body kinematics estimation and motion capture , 2003, 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 2003. Proceedings..

[14]  Jarek Rossignac,et al.  Dynapack: space-time compression of the 3D animations of triangle meshes with fixed connectivity , 2003, SCA '03.

[15]  Dietmar Saupe,et al.  Compression of Point-Based 3D Models by Shape-Adaptive Wavelet Coding of Multi-Height Fields , 2004, PBG.

[16]  Radu Horaud,et al.  Hand Motion from 3D Point Trajectories and a Smooth Surface Model , 2004, ECCV.

[17]  Craig Gotsman,et al.  Compression of soft-body animation sequences , 2004, Comput. Graph..

[18]  Jinghua Zhang,et al.  Octree-based animated geometry compression , 2004, Data Compression Conference, 2004. Proceedings. DCC 2004.

[19]  Ralf Sarlette,et al.  Simple and efficient compression of animation sequences , 2005, SCA '05.

[20]  Hans-Peter Seidel,et al.  Predictive point-cloud compression , 2005, SIGGRAPH '05.

[21]  Y. Aloimonos,et al.  Discovering a Language for Human Activity 1 , 2005 .

[22]  Ketan Mayer-Patel,et al.  Real-time multidepth stream compression , 2005, TOMCCAP.

[23]  Ruzena Bajcsy,et al.  TEEVE: the next generation architecture for tele-immersive environments , 2005, Seventh IEEE International Symposium on Multimedia (ISM'05).

[24]  R. Rojas,et al.  Stereo tracking , 2005 .

[25]  Okan Arikan.  Compression of motion capture databases , 2006, ACM Trans. Graph..

[26]  William Yurcik,et al.  Real-time 3D video compression for tele-immersive environments , 2006, Electronic Imaging.

[27]  Rüdiger Dillmann,et al.  Sensor fusion for 3D human body tracking with an articulated 3D body model , 2006, Proceedings 2006 IEEE International Conference on Robotics and Automation, 2006. ICRA 2006..

[28]  Yiannis Aloimonos,et al.  Human Activity Language: Grounding Concepts with a Linguistic Framework , 2006, SAMT.