3D Graphics Reconstruction, Compression and Animation

This work covers entire pipeline of a 3D immersive system, comprising acquistion and reconstruction of 3D objects, transforming the 3D objects into popular 3D format, compression of data with MPEG-4 compliant encoders and acquisition of animation motion data. For the acquisition part we created 3D human face object with the help of depth-field camera, in particular we used Microsoft Kinect. We process the raw data given by Kinect and transform it into a mesh, and texture it with photometric data. The reconstructed objects are quiet large in size and need to be compressed for an efficient network transmission. We encoded the objects using MPEG-4 encoder, and measured the performance of scalable mesh encoding techniques. For an interactive immersive application, motion data of player must be cap-tured, which is transmitted to remote client for playing the animation on the virtual character of player. For this purpose MPEG-4 standard defines a Bone Based An-imation to acquire and compress the motion data. We acquired the motion data of a player using a novel algorithm which is compliant to bone based animation. Our proposed approach of extracting motion data is computationally efficient

[1]  Olivier Devillers,et al.  Geometric compression for interactive transmission , 2000 .

[2]  Titus B. Zaharia,et al.  TFAN: A low complexity 3D mesh compression algorithm , 2009, Comput. Animat. Virtual Worlds.

[3]  Faming Gong,et al.  3D Mesh Skeleton Extraction Based on Feature Points , 2009, 2009 International Conference on Computer Engineering and Technology.

[4]  Junjie Cao,et al.  Point Cloud Skeletons via Laplacian Based Contraction , 2010, 2010 Shape Modeling International Conference.

[5]  Gabriel Taubin,et al.  Geometric compression through topological surgery , 1998, TOGS.

[6]  Craig Gotsman,et al.  Triangle Mesh Compression , 1998, Graphics Interface.

[7]  Ruzena Bajcsy,et al.  High-Quality Visualization for Geographically Distributed 3-D Teleimmersive Applications , 2011, IEEE Transactions on Multimedia.

[8]  Gabriel Taubin,et al.  Progressive forest split compression , 1998, SIGGRAPH.

[9]  Giseok Son,et al.  Simple and Fast Compression of 3D Meshes , 2007, 2007 International Conference on Convergence Information Technology (ICCIT 2007).

[10]  Martin Isenburg,et al.  Face fixer: compressing polygon meshes with properties , 2000, SIGGRAPH.

[11]  Mongi A. Abidi,et al.  3d video generation and service based on a TOF depth sensor in MPEG-4 multimedia framework , 2010, IEEE Transactions on Consumer Electronics.

[12]  Touradj Ebrahimi,et al.  MESH: measuring errors between surfaces using the Hausdorff distance , 2002, Proceedings. IEEE International Conference on Multimedia and Expo.

[13]  Françoise J. Prêteux,et al.  MPEG-4 Part 25: A graphics compression framework for XML-based scene graph formats , 2009, Signal Process. Image Commun..

[14]  Yo-Sung Ho,et al.  3-D video generation using hybrid camera system , 2009, IMMERSCOM.

[15]  Jarek Rossignac,et al.  Through the Cracks of the Solid Modeling Milestone , 1994 .

[16]  Françoise J. Prêteux,et al.  Advanced animation framework for virtual character within the MPEG-4 standard , 2002, Proceedings. International Conference on Image Processing.

[17]  Jarek Rossignac,et al.  Edgebreaker: Connectivity Compression for Triangle Meshes , 1999, IEEE Trans. Vis. Comput. Graph..

[18]  Barry E. Mullins,et al.  An analysis of XML compression efficiency , 2007, ExpCS '07.

[19]  Martin Isenburg,et al.  Compressing polygon mesh geometry with parallelogram prediction , 2002, IEEE Visualization, 2002. VIS 2002..

[20]  Kostas Daniilidis,et al.  Real time trinocular stereo for tele-immersion , 2001, Proceedings 2001 International Conference on Image Processing (Cat. No.01CH37205).

[21]  Zoltan-Csaba Marton,et al.  On Fast Surface Reconstruction Methods for Large and Noisy Datasets , 2009, IEEE International Conference on Robotics and Automation.

[22]  Jérémie Allard,et al.  Multicamera Real-Time 3D Modeling for Telepresence and Remote Collaboration , 2010, Int. J. Digit. Multim. Broadcast..