Motion Segmentation and Retrieval for 3D Video Based on Modified Shape Distribution

A similar motion search and retrieval system for 3D video are presented based on a modified shape distribution algorithm. 3D video is a sequence of 3D models made for a real-world object. In the present work, three fundamental functions for efficient retrieval have been developed: feature extraction, motion segmentation, and similarity evaluation. Stable-shape feature representation of 3D models has been realized by a modified shape distribution algorithm. Motion segmentation has been conducted by analyzing the degree of motion using the extracted feature vectors. Then, similar motion retrieval has been achieved employing the dynamic programming algorithm in the feature vector space. The experimental results using 3D video sequences of dances have demonstrated very promising results for motion segmentation and retrieval.

[1]  Yuichi Iwadate,et al.  Algorithm for dynamic 3D object generation from multi-viewpoint images , 2004, SPIE Optics East.

[2]  Nicola J. Ferrier,et al.  Repetitive motion analysis: segmentation and event classification , 2004, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[3]  Yasuhiko Sakamoto,et al.  Motion map: image-based retrieval and segmentation of motion data , 2004, SCA '04.

[4]  Peter Eisert,et al.  Predictive compression of dynamic 3D meshes , 2005, IEEE International Conference on Image Processing 2005.

[5]  Ramesh C. Jain,et al.  Using Dynamic Programming for Solving Variational Problems in Vision , 1990, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Kiyoharu Aizawa,et al.  3D video segmentation using point distance histograms , 2005, IEEE International Conference on Image Processing 2005.

[7]  Markus H. Gross,et al.  3D video recorder , 2002, 10th Pacific Conference on Computer Graphics and Applications, 2002. Proceedings..

[8]  Takeo Kanade,et al.  Virtualized Reality: Constructing Virtual Worlds from Real Scenes , 1997, IEEE Multim..

[9]  Chih-Yi Chiu,et al.  Content-based retrieval for human motion data , 2004, J. Vis. Commun. Image Represent..

[10]  Hermann Ney,et al.  Dynamic programming search for continuous speech recognition , 1999, IEEE Signal Process. Mag..

[11]  S. Ortmanns,et al.  Progress in dynamic programming search for LVCSR , 1997, Proceedings of the IEEE.

[12]  P. B. Coaker,et al.  Applied Dynamic Programming , 1964 .

[13]  Xiaojun Wu,et al.  Real-time dynamic 3-D object shape reconstruction and high-fidelity texture mapping for 3-D video , 2004, IEEE Transactions on Circuits and Systems for Video Technology.

[14]  Meinard Müller,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH '05.

[15]  Bernard Chazelle,et al.  Shape distributions , 2002, TOGS.

[16]  Xiaojun Wu,et al.  Real-time 3D shape reconstruction, dynamic 3D mesh deformation, and high fidelity visualization for 3D video , 2004, Comput. Vis. Image Underst..

[17]  Remco C. Veltkamp,et al.  A survey of content based 3D shape retrieval methods , 2004, Proceedings Shape Modeling Applications, 2004..

[18]  T. Matsuyama,et al.  SKIN-OFF: REPRESENTATION AND COMPRESSION SCHEME FOR 3D VIDEO , 2004 .

[19]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[20]  Jernej Barbic,et al.  Segmenting Motion Capture Data into Distinct Behaviors , 2004, Graphics Interface.

[21]  H. Saito,et al.  Free-viewpoint image synthesis from multiple-view images taken with uncalibrated moving cameras , 2005, IEEE International Conference on Image Processing 2005.

[22]  Dimitri P. Bertsekas,et al.  Dynamic Programming and Optimal Control, Two Volume Set , 1995 .

[23]  Sethuraman Panchanathan,et al.  Automated gesture segmentation from dance sequences , 2004, Sixth IEEE International Conference on Automatic Face and Gesture Recognition, 2004. Proceedings..

[24]  Kiyoharu Aizawa,et al.  Motion Segmentation of 3D Video using Modified Shape Distribution , 2006, 2006 IEEE International Conference on Multimedia and Expo.

[25]  Atsushi Nakazawa,et al.  Rhythmic motion analysis using motion capture and musical information , 2003, Proceedings of IEEE International Conference on Multisensor Fusion and Integration for Intelligent Systems, MFI2003..