Towards realtime measurement of connectedness in human movement

With the proliferation of wearable sensors, we have access to rich information regarding human movement that gives us insights into our daily activities like never before. In a sensor rich environment, it is desirable to build systems that are aware of human interactions by studying contextual information. In this paper, we attempt to quantify one such contextual cue - the connectedness of physical movement. Inspired by the Semblance of Typology Entrainments, we estimate the connectedness of trained dancers as observed from inertial sensors, using a diverse set of techniques such as quaternion correlation, approximate entropy, Fourier temporal pyramids, and discrete cosine transform. Preliminary experiments show that it is possible to robustly estimate connectedness that is invariant to frequency, amplitude, noise or time lag.

[1]  Antonio Torralba,et al.  Assessing the Quality of Actions , 2014, ECCV.

[2]  Michael J. Richardson,et al.  Social Connection Through Joint Action and Interpersonal Coordination , 2009, Top. Cogn. Sci..

[3]  S. Pincus,et al.  Randomness and degrees of irregularity. , 1996, Proceedings of the National Academy of Sciences of the United States of America.

[4]  Carol Parkinson,et al.  Proceedings of the 7th international conference on New interfaces for musical expression , 2007 .

[5]  Stephen J. Sangwine,et al.  Decomposition of 2D Hypercomplex Fourier transforms into pairs of complex fourier transforms , 2000, 2000 10th European Signal Processing Conference.

[6]  Mohamed Chetouani,et al.  Interpersonal Synchrony: A Survey of Evaluation Methods across Disciplines , 2012, IEEE Transactions on Affective Computing.

[7]  Mawardi Bahri,et al.  Relationships between Convolution and Correlation for Fourier Transform and Quaternion Fourier Transform , 2013 .

[8]  Joseph A. Paradiso,et al.  Sensemble: A Wireless, Compact, Multi-User Sensor System for Interactive Dance , 2006, NIME.

[9]  Soo-Chang Pei,et al.  Efficient implementation of quaternion Fourier transform, convolution, and correlation by 2-D complex FFT , 2001, IEEE Trans. Signal Process..

[10]  Joseph A. Paradiso,et al.  A compact, wireless, wearable sensor network for interactive dance ensembles , 2006, International Workshop on Wearable and Implantable Body Sensor Networks (BSN'06).

[11]  S M Pincus,et al.  Approximate entropy as a measure of system complexity. , 1991, Proceedings of the National Academy of Sciences of the United States of America.

[12]  Ying Wu,et al.  Mining actionlet ensemble for action recognition with depth cameras , 2012, 2012 IEEE Conference on Computer Vision and Pattern Recognition.