Bayesian reasoning for Laban Movement Analysis used in human-machine interaction

We present the implementation of computational Laban Movement Analysis (LMA) for human-machine interaction using Bayesian reasoning. The research field of computational human movement analysis is lacking a general underlying modelling language, i.e., how to map the features into symbols. With such a semantic descriptor, the recognition problem can be posed as a problem to recognise a sequence of symbols taken from an alphabet consisting of motion-entities. LMA has been proven successful in areas where humans are observing other humans' movements. LMA provides a model for observation and description and a notational system (Labanotation). To implement LMA in a computer, we have chosen a Bayesian approach. The framework allows us to model the process, learn the dependencies between features and symbols and to perform online classification using LMA-labels. We have chosen the application 'social robots' to demonstrate the feasibility of our solution.

[1]  Rómer Rosales,et al.  Learning and synthesizing human body motion and posture , 2000, Proceedings Fourth IEEE International Conference on Automatic Face and Gesture Recognition (Cat. No. PR00580).

[2]  Hiroshi Mizoguchi,et al.  Robotic room: Symbiosis with human through behavior media , 1996, Robotics Auton. Syst..

[3]  Norman I. Badler,et al.  Simulating humans: computer graphics animation and control , 1993 .

[4]  Pierre Bessière,et al.  A Survey of Probabilistic Models Using the Bayesian Programming Methodology as a Unifying Framework , 2003 .

[5]  I. Golani.  Homeostatic Motor Processes in Mammalian Interactions: A Choreography of Display , 1976 .

[6]  Jake K. Aggarwal,et al.  Human Motion Analysis: A Review , 1999, Comput. Vis. Image Underst..

[7]  J. Rett,et al.  Human-robot interface with anticipatory characteristics based on Laban Movement Analysis and Bayesian models , 2007, 2007 IEEE 10th International Conference on Rehabilitation Robotics.

[8]  Thad Starner,et al.  Visual Recognition of American Sign Language Using Hidden Markov Models. , 1995 .

[9]  Tomomasa Sato,et al.  Analysis of Impression of Robot Bodily Expression , 2002, J. Robotics Mechatronics.

[10]  Jorge Dias,et al.  Visual Based Human Motion Analysis: Mapping Gestures Using a Puppet Model , 2005, EPIA.

[11]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[12]  Thomas B. Moeslund,et al.  A Survey of Computer Vision-Based Human Motion Capture , 2001, Comput. Vis. Image Underst..

[13]  Cynthia Breazeal,et al.  Toward sociable robots , 2003, Robotics Auton. Syst..

[14]  Christian Laugier,et al.  Probabilistic Reasoning and Decision Making in Sensory-Motor Systems , 2008, Springer Tracts in Advanced Robotics.

[15]  Illah R. Nourbakhsh,et al.  A survey of socially interactive robots , 2003, Robotics Auton. Syst..

[16]  Christoph Bregler,et al.  Learning and recognizing human dynamics in video sequences , 1997, Proceedings of IEEE Computer Society Conference on Computer Vision and Pattern Recognition.

[17]  Wolfram Burgard,et al.  The Interactive Museum Tour-Guide Robot , 1998, AAAI/IAAI.

[18]  Jeffrey Scott Longstaff.  TRANSLATING 'VECTOR SYMBOLS' FROM LABAN'S (1926) CHOREOGRAPHIE , 2001 .

[19]  Illah R. Nourbakhsh,et al.  The mobot museum robot installations: a five year experiment , 2003, Proceedings 2003 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS 2003) (Cat. No.03CH37453).

[20]  Mohammed Yeasin,et al.  Prosody based co-analysis for continuous recognition of coverbal gestures , 2002, Proceedings. Fourth IEEE International Conference on Multimodal Interfaces.

[21]  C. E. SHANNON,et al.  A mathematical theory of communication , 1948, MOCO.

[22]  I. Bartenieff,et al.  Body Movement: Coping with the Environment , 1980 .

[23]  Norman I. Badler,et al.  Synthesis and acquisition of laban movement analysis qualitative parameters for communicative gestures , 2001 .

[24]  Norman I. Badler,et al.  Acquiring and validating motion qualities from live limb gestures , 2005, Graph. Model..

[25]  Dariu Gavrila,et al.  The Visual Analysis of Human Movement: A Survey , 1999, Comput. Vis. Image Underst..

[26]  Ian Q. Whishaw,et al.  Changes in the kinematic structure and non-kinematic features of movements during skilled reaching after stroke: A Laban Movement Analysis in two case studies , 2006, Journal of Neuroscience Methods.

[27]  Alex Pentland,et al.  Looking at People: Sensing for Ubiquitous and Wearable Computing , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[28]  D. Knill,et al.  The Bayesian brain: the role of uncertainty in neural coding and computation , 2004, Trends in Neurosciences.

[29]  M. Little,et al.  La Danse noble: An Inventory of Dances and Sources , 1994 .

[30]  A. Kendon.  Gesture: Visible Action as Utterance , 2004 .

[31]  Jorge Dias,et al.  Laban Movement Analysis Using a Bayesian Model and Perspective Projections , 2008 .

[32]  Jörg Rett,et al.  Robot-human interface using laban movement analysis inside a bayesian framework , 2009 .

[33]  Rüdiger Dillmann,et al.  Distribution and Recognition of Gestures in Human-Robot Interaction , 2006, ROMAN 2006 - The 15th IEEE International Symposium on Robot and Human Interactive Communication.

[34]  R. Benesh,et al.  Reading Dance: The Birth of Choreology , 1977 .

[35]  Kerstin Dautenhahn,et al.  The Art of Designing Socially Intelligent Agents: Science, Fiction, and the Human in the Loop , 1998, Appl. Artif. Intell..

[36]  Wolfram Burgard,et al.  Experiences with an Interactive Museum Tour-Guide Robot , 1999, Artif. Intell..

[37]  Nicla Rossini.  The Analysis of Gesture: Establishing a Set of Parameters , 2003, Gesture Workshop.

[38]  Vladimir Pavlovic,et al.  Dynamic bayesian networks for information fusion with applications to human-computer interfaces , 1999 .

[39]  Sang Joon Kim,et al.  A Mathematical Theory of Communication , 2006 .

[40]  Alex Pentland,et al.  Real-Time American Sign Language Recognition Using Desk and Wearable Computer Based Video , 1998, IEEE Trans. Pattern Anal. Mach. Intell..

[41]  Roland Siegwart,et al.  Robox at Expo.02: A large-scale installation of personal robots , 2003, Robotics Auton. Syst..

[42]  Norman I. Badler,et al.  The EMOTE model for effort and shape , 2000, SIGGRAPH.