Human-Human Interactional Synchrony Analysis Based on Body Sensor Networks

Human-human interactions are widespread in many fields, but rarely investigated by using body sensor networks (BSNs). Due to the fact that distributed sensors can only provide local information, this paper proposes to analyse the interactional synchrony from both local and overall perspectives. The proposed framework analyses synchrony mainly including windowed cross-correlation, peak picking method and power average operator. Experiments conducted in this paper demonstrate that the proposed framework may not only distinguish between synchrony and asynchrony conditions, but also reveal different situations corresponding to different body parts.

[1]  Ronald R. Yager,et al.  The power average operator , 2001, IEEE Trans. Syst. Man Cybern. Part A.

[2]  S. Boker,et al.  Windowed cross-correlation and peak picking for the analysis of variability in the association between behavioral time series. , 2002, Psychological methods.

[3]  Jeffrey M. Hausdorff,et al.  The sensory feedback mechanisms enabling couples to walk synchronously: An initial investigation , 2007, Journal of NeuroEngineering and Rehabilitation.

[4]  Scott S. Wiltermuth,et al.  Synchrony and Cooperation , 2009, Psychological science.

[5]  Rong Liu,et al.  Recognizing Human Activities Based on Multi-Sensors Fusion , 2010, 2010 4th International Conference on Bioinformatics and Biomedical Engineering.

[6]  D. DeSteno,et al.  The rhythm of joint action: Synchrony promotes cooperative ability , 2010 .

[7]  Mahdi Khodabandeh,et al.  Experimental study of uncertainty measures with sensor fusion techniques , 2010, 2010 2nd International Asia Conference on Informatics in Control, Automation and Robotics (CAR 2010).

[8]  Sandra Hirche,et al.  Synchronization in a goal-directed task: Human movement coordination with each other and robotic partners , 2011, 2011 RO-MAN.

[9]  Anton Nijholt,et al.  Towards visual and vocal mimicry recognition in human-human interactions , 2011, 2011 IEEE International Conference on Systems, Man, and Cybernetics.

[10]  Michael J. Richardson,et al.  Measuring the Dynamics of Interactional Synchrony , 2012 .

[11]  Zheyao Wang,et al.  Motion Measurement Using Inertial Sensors, Ultrasonic Sensors, and Magnetometers With Extended Kalman Filter for Data Fusion , 2012, IEEE Sensors Journal.

[12]  Yoshihiro Miyake,et al.  Interpersonal synchrony-based dynamic stabilization of the gait rhythm between human and virtual robot — Clinical application to festinating gait of Parkinson's disease patient , 2012, 2012 International Symposium on Micro-NanoMechatronics and Human Science (MHS).

[13]  Mohamed Chetouani,et al.  Interpersonal Synchrony: A Survey of Evaluation Methods across Disciplines , 2012, IEEE Transactions on Affective Computing.

[14]  Fakhri Karray,et al.  Multisensor data fusion: A review of the state-of-the-art , 2013, Inf. Fusion.

[15]  Yoshihiro Miyake,et al.  Head motion synchronization in the process of consensus building , 2013, Proceedings of the 2013 IEEE/SICE International Symposium on System Integration.

[16]  Roozbeh Jafari,et al.  Enabling Effective Programming and Flexible Management of Efficient Body Sensor Network Applications , 2013, IEEE Transactions on Human-Machine Systems.

[17]  Alaa M. Khamis,et al.  Bayesian approach to multisensor data fusion with Pre- and Post-Filtering , 2013, 2013 10th IEEE INTERNATIONAL CONFERENCE ON NETWORKING, SENSING AND CONTROL (ICNSC).

[18]  Simon Lucey,et al.  Temporal coordination of head motion in couples with history of interpersonal violence , 2013, 2013 10th IEEE International Conference and Workshops on Automatic Face and Gesture Recognition (FG).

[19]  F. Ramseyer,et al.  Nonverbal synchrony of head- and body-movement in psychotherapy: different signals have different associations with outcome , 2014, Front. Psychol..

[20]  F. Ramseyer,et al.  Nonverbal synchrony and affect in dyadic interactions , 2014, Front. Psychol..

[21]  Yoshiko Arimoto,et al.  Emotional synchrony and covariation of behavioral/physiological reactions between interlocutors , 2014, 2014 17th Oriental Chapter of the International Committee for the Co-ordination and Standardization of Speech Databases and Assessment Techniques (COCOSDA).

[22]  Noel E. O'Connor,et al.  Automatic Activity Classification and Movement Assessment During a Sports Training Session Using Wearable Inertial Sensors , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[23]  Daniele Comotti,et al.  A Novel Body Sensor Network for Parkinson's Disease Patients Rehabilitation Assessment , 2014, 2014 11th International Conference on Wearable and Implantable Body Sensor Networks.

[24]  Marco Avvenuti,et al.  Are we synchronized? Measure synchrony in team sports using a network of wireless accelerometers , 2014, IWWISS.

[25]  Joseph Bulbulia,et al.  Does synchrony promote generalized prosociality? , 2014 .

[26]  Hassan Ghasemzadeh,et al.  Power-Aware Activity Monitoring Using Distributed Wearable Sensors , 2014, IEEE Transactions on Human-Machine Systems.

[27]  Giancarlo Fortino,et al.  A framework for collaborative computing and multi-sensor data fusion in body sensor networks , 2015, Inf. Fusion.

[28]  Daniel S. Messinger,et al.  Unsupervised Synchrony Discovery in Human Interaction , 2015, 2015 IEEE International Conference on Computer Vision (ICCV).

[29]  Daniel S. Messinger,et al.  Head Movement Dynamics during Play and Perturbed Mother-Infant Interaction , 2015, IEEE Transactions on Affective Computing.

[30]  Zhelong Wang,et al.  Stance-Phase Detection for ZUPT-Aided Foot-Mounted Pedestrian Navigation System , 2015, IEEE/ASME Transactions on Mechatronics.

[31]  Angelica Munoz-Melendez,et al.  Wearable Inertial Sensors for Human Motion Analysis: A Review , 2016, IEEE Sensors Journal.

[32]  Bogdan Raducanu,et al.  Head-gestures mirroring detection in dyadic social interactions with computer vision-based wearable devices , 2016, Neurocomputing.

[33]  Huosheng Hu,et al.  Using Distributed Wearable Sensors to Measure and Evaluate Human Lower Limb Motions , 2016, IEEE Transactions on Instrumentation and Measurement.

[34]  Ning Yang,et al.  Synchrony expression analysis of human-human interaction using wearable sensors , 2016, 2016 12th IEEE International Conference on Control and Automation (ICCA).

[35]  Ahmed Ghoneim,et al.  A Triaxial Accelerometer-Based Human Activity Recognition via EEMD-Based Features and Game-Theory-Based Feature Selection , 2016, IEEE Sensors Journal.