Using Dynamics to Recognize Human Motion

We explore the importance of the dynamics of motion, and how it can be used first to develop and to personalize intelligent systems that can understand human motions, then to analyze motions. We propose a framework that uses not only the kinematics information of movements but also the dynamics and allows to classify, analyze and recognize motions, emotions in a non-verbal context. We use the direct measure of the dynamics when available. If not we propose to compute the dynamics from the kinematics, and use it to understand human motions. Finally, we discuss some developments and concrete applications in the field of motion analysis and give some experimental results using gait and simple choreography.

[1]  Jessica K. Hodgins,et al.  Synthesizing physically realistic human motion in low-dimensional, behavior-specific spaces , 2004, SIGGRAPH 2004.

[2]  坂入 洋右,et al.  Development of the Two Dimension Mood Scale for Measuring Psychological Arousal Level and Hedonic Tone , 2003 .

[3]  Atsuo Kawamura,et al.  Robust biped walking with active interaction control between foot and ground , 1998, Proceedings. 1998 IEEE International Conference on Robotics and Automation (Cat. No.98CH36146).

[4]  Gentiane Venture,et al.  Motion recognition from contact forces information and identification of the human body dynamics , 2010, 2010 3rd IEEE RAS & EMBS International Conference on Biomedical Robotics and Biomechatronics.

[5]  A. Mizuno,et al.  A change of the leading player in flow Visualization technique , 2006, J. Vis..

[6]  Takashi Taniguchi,et al.  Construction of an Affective Value Scale of Music and Examination of Relations between the Scale and a Multiple Mood Scale , 1995 .

[7]  Worawat Choensawat,et al.  GenLaban: A tool for generating Labanotation from motion capture data , 2014, Multimedia Tools and Applications.

[8]  Alin Albu-Schäffer,et al.  Human-Like Adaptation of Force and Impedance in Stable and Unstable Interactions , 2011, IEEE Transactions on Robotics.

[9]  R. Laban,et al.  The mastery of movement , 1950 .

[10]  Ruzena Bajcsy,et al.  Sequence of the Most Informative Joints (SMIJ): A new representation for human skeletal action recognition , 2012, 2012 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.

[11]  M. Murugappan.  Electromyogram signal based human emotion classification using KNN and LDA , 2011, 2011 IEEE International Conference on System Engineering and Technology.

[12]  Ann Hutchinson Guest.  Dance notation : the process of recording movement on paper , 1986 .

[13]  Gentiane Venture,et al.  Individual Recognition from Gait Using Feature Value Method , 2012 .

[14]  Shigeki Yokoi,et al.  Automatic composition and simulation system for ballet sequences , 2006, 2006 International Conference on Cyberworlds.

[15]  Yoshihiko Nakamura,et al.  Symbolic Memory of Motion Patterns by an Associative Memory Dynamics with Self-organizing Nonmonotonicity , 2007, ICONIP.

[16]  Claire L. Roether,et al.  Critical features for the perception of emotion from gait. , 2009, Journal of vision.

[17]  B. Gelder.  Towards the neurobiology of emotional body language , 2006, Nature Reviews Neuroscience.

[18]  Gentiane Venture,et al.  Human motion classification and recognition using wholebody contact force , 2015, 2015 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS).

[19]  Wisama Khalil,et al.  Modeling, Identification & Control of Robots , 2002 .

[20]  Gregor Schöner,et al.  The uncontrolled manifold concept: identifying control variables for a functional task , 1999, Experimental Brain Research.

[21]  Paul F. Newbury,et al.  Real Time Online Motion Capture for Entertainment Applications , 2010, 2010 Third IEEE International Conference on Digital Game and Intelligent Toy Enhanced Learning.

[22]  Ann Hutchinson Guest.  Choreographics: A Comparison of Dance Notation Systems from the Fifteenth Century to the Present , 1991, Dance Research Journal.

[23]  Aydn Teozeren.  Human body dynamics , 2013 .

[24]  Pieter Desmet,et al.  Measuring Emotion: Development and Application of an Instrument to Measure Emotional Responses to Products , 2005, Funology.

[25]  Gentiane Venture,et al.  Motion recognition from contact force measurement , 2013, 2013 35th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC).

[26]  Gentiane Venture,et al.  Recognizing Emotions Conveyed by Human Gait , 2014, International Journal of Social Robotics.

[27]  Veikko Surakka,et al.  Real-time estimation of emotional experiences from facial expressions , 2006, Interact. Comput..

[28]  Yoshihiko Nakamura,et al.  Humanoid Robot's Autonomous Acquisition of Proto-Symbols through Motion Segmentation , 2006, 2006 6th IEEE-RAS International Conference on Humanoid Robots.

[29]  Anna Gruebler,et al.  Measurement of distal EMG signals using a wearable device for reading facial expressions , 2010, 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology.

[30]  Dana Kulic,et al.  Online Segmentation and Clustering From Continuous Observation of Whole Body Motions , 2009, IEEE Transactions on Robotics.

[31]  Ann Hutchinson Guest.  Labanotation: The System of Analyzing and Recording Movement , 1987 .

[32]  Masaru Uchiyama,et al.  Moving Base Robotics and Reaction Management Control , 1996 .

[33]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[34]  M. Shiffrar,et al.  Recognizing people from their movement. , 2005, Journal of experimental psychology. Human perception and performance.

[35]  A. Tozeren,et al.  Human Body Dynamics: Classical Mechanics and Human Movement , 1999 .