SEMANTIC ANALYSIS AND DATA STORAGE OF SKILLS

The analysis of complex motor skills for the transfer of expertise to trainees requires not only advancements in capturing and rendering technologies, but also research in the area of modeling, representation and storage. This talk presents the aspects of skills processing related to the encoding of the digital skill expressed in terms of decomposition of fundamental elements of the skill. The Multimodal Data System (MMDS) is introduced as a framework for the skill processing, with details related to storage and distributed processing of data.

[1]  Matthew Wright,et al.  Panel: the Need of Formats for Streaming and Storing Music-Related movement and Gesture Data , 2007, ICMC.

[2]  James Park,et al.  The Brain's Sense of Movement , 2003, The Yale Journal of Biology and Medicine.

[3]  Georg Bretthauer,et al.  A Prospective Randomized Study to Test the Transfer of Basic Psychomotor Skills From Virtual Reality to Physical Reality in a Comparable Training Setting , 2005, Annals of surgery.

[4]  R. Bowen Loftin,et al.  Training the Hubble space telescope flight team , 1995, IEEE Computer Graphics and Applications.

[5]  M I Posner,et al.  Components of skilled performance. , 1966, Science.

[6]  Akihito Sano,et al.  Machine mediated training based on coaching , 1999, IEEE SMC'99 Conference Proceedings. 1999 IEEE International Conference on Systems, Man, and Cybernetics (Cat. No.99CH37028).

[7]  R.M. de Moraes,et al.  Hidden Markov Models For Learning Evaluation In Virtual-Reality Simulators , 2003 .

[8]  Yoichi Takebayashi,et al.  Sound Feedback for Powerful Karate Training , 2004, NIME.

[9]  W. H. Warren.  The dynamics of perception and action. , 2006, Psychological review.

[10]  Didier Stricker,et al.  Lessons learned on the way to industrial augmented reality applications, a retrospective on ARVIKA , 2003, Comput. Graph..

[11]  Tsuneo Yoshikawa,et al.  Toward machine mediated training of motor skills. Skill transfer from human to human via virtual environment , 1996, Proceedings 5th IEEE International Workshop on Robot and Human Communication. RO-MAN'96 TSUKUBA.

[12]  A. Darzi,et al.  Assessing operative skill , 1999, BMJ.

[13]  Massimo Bergamasco,et al.  Development of a 3D real time gesture recognition methodology for virtual environment control , 2008, RO-MAN 2008 - The 17th IEEE International Symposium on Robot and Human Interactive Communication.

[14]  M. Turvey,et al.  Maintenance tendency in co-ordinated rhythmic movements: Relative fluctuations and phase , 1988, Neuroscience.

[15]  Tido Röder,et al.  Efficient content-based retrieval of motion capture data , 2005, SIGGRAPH 2005.

[16]  N. Stergiou,et al.  Robotic surgery training and performance , 2005, Surgical Endoscopy And Other Interventional Techniques.

[17]  Aude Billard,et al.  Discriminative and adaptive imitation in uni-manual and bi-manual tasks , 2006, Robotics Auton. Syst..

[18]  Ning Hu,et al.  Training for physical tasks in virtual environments: Tai Chi , 2003, IEEE Virtual Reality, 2003. Proceedings..

[19]  東京物理學校,et al.  理學 : The science , 1946 .

[20]  Antonio Frisoli,et al.  Reactive robot system using a haptic interface: an active interaction to transfer skills from the robot to unskilled persons , 2007, Adv. Robotics.

[21]  M. A. Foley,et al.  The effects of enactive encoding, type of movement, and imagined perspective on memory of dance , 1991 .

[22]  Erkki Oja,et al.  Independent Component Analysis , 2001 .

[23]  Andrew Y. C. Nee,et al.  Augmented reality for assembly guidance using a virtual interactive tool , 2008 .

[24]  Russell M. Taylor,et al.  VRPN: a device-independent, network-transparent VR peripheral system , 2001, VRST '01.

[25]  Donald F. Specht,et al.  Probabilistic neural networks and general regression neural networks , 1996 .

[26]  Christopher H. Lee,et al.  Learning Reduced-Dimension Models of Human Actions , 2000 .

[27]  Yuichi Motai,et al.  Learning by observation of robotic tasks using on-line PCA-based Eigen behavior , 2005, 2005 International Symposium on Computational Intelligence in Robotics and Automation.

[28]  Tae-Kyun Kim,et al.  Learning Motion Categories using both Semantic and Structural Information , 2007, 2007 IEEE Conference on Computer Vision and Pattern Recognition.

[29]  Wolfgang Klas,et al.  An analysis of XML database solutions for the management of MPEG-7 media descriptions , 2003, CSUR.

[30]  Shih-Fu Chang,et al.  Overview of the MPEG-7 standard , 2001, IEEE Trans. Circuits Syst. Video Technol..

[31]  Blake Hannaford,et al.  The Blue DRAGON--a system for monitoring the kinematics and the dynamics of endoscopic tools in minimally invasive surgery for objective laparoscopic skill assessment. , 2002, Studies in health technology and informatics.

[32]  Christopher L. Salter,et al.  Schwelle: sensor augmented, adaptive sound design for live theatrical performance , 2007, NIME '07.