Time synchronization and data fusion for RGB-Depth cameras and inertial sensors in AAL applications

Ambient Assisted Living applications often need to integrate data from multiple sensors, to provide consistent information on the observed phenomena. Data fusion based on samples from several sensors requires accurate time synchronization with sufficient resolution, depending on the sensor sampling frequency. This work presents a technical platform for the efficient and accurate synchronization of the data captured from RGB-Depth cameras and wearable inertial sensors, that can be integrated in AAL solutions. A case study of sensor data fusion for Timed Up and Go test is also presented and discussed.

[1]  Flaviu Cristian,et al.  Probabilistic clock synchronization , 1989, Distributed Computing.

[2]  Ennio Gambi,et al.  A Depth-Based Fall Detection System Using a Kinect® Sensor , 2014, Sensors.

[3]  K. Dietmayer,et al.  DATA SYNCHRONIZATION STRATEGIES FOR MULTI-SENSOR FUSION , 2003 .

[4]  Barry R. Greene,et al.  Quantitative Falls Risk Assessment Using the Timed Up and Go Test , 2010, IEEE Transactions on Biomedical Engineering.

[5]  M. Sekine,et al.  Quantitative evaluation of movement using the timed up-and-go test , 2008, IEEE Engineering in Medicine and Biology Magazine.

[6]  Noel E. O'Connor,et al.  Low-cost accurate skeleton tracking based on fusion of kinect and wearable inertial sensors , 2014, 2014 22nd European Signal Processing Conference (EUSIPCO).

[7]  Ennio Gambi,et al.  Kinect as a Tool for Gait Analysis: Validation of a Real-Time Joint Extraction Algorithm Working in Side View , 2015, Sensors.

[8]  Sergio Escalera,et al.  Actions in Context: System for People with Dementia , 2013, CitiSens.

[9]  Mohammad H. Mahoor,et al.  Automatic measurement of physical mobility in Get-Up-and-Go Test using kinect sensor , 2014, 2014 36th Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[10]  A Cappozzo,et al.  Sit-to-stand motor strategies investigated in able-bodied young and elderly subjects. , 2000, Journal of biomechanics.

[11]  K. Kerr,et al.  Analysis of the sit-stand-sit movement cycle in normal subjects. , 1997, Clinical biomechanics.

[12]  Thomas Lindh,et al.  Local Time Synchronization in Bluetooth Piconets for Data Fusion Using Mobile Phones , 2011, 2011 International Conference on Body Sensor Networks.

[13]  F. Horak,et al.  iTUG, a Sensitive and Reliable Measure of Mobility , 2010, IEEE Transactions on Neural Systems and Rehabilitation Engineering.

[14]  Thomas Lindh,et al.  A novel approach to multi-sensor data synchronisation using mobile phones , 2013, Int. J. Auton. Adapt. Commun. Syst..

[15]  Nasser Kehtarnavaz,et al.  Fusion of Inertial and Depth Sensor Data for Robust Hand Gesture Recognition , 2014, IEEE Sensors Journal.

[16]  George Coulouris,et al.  Distributed systems - concepts and design , 1988 .

[17]  Adrian Burns,et al.  SHIMMER™ – A Wireless Sensor Platform for Noninvasive Biomedical Research , 2010, IEEE Sensors Journal.

[18]  Tim Kindberg,et al.  Distributed Systems: Concepts and Design (4th Edition) (International Computer Science) , 2005 .

[19]  V. Weerdesteyn,et al.  Falls in individuals with stroke. , 2008, Journal of rehabilitation research and development.