Position and Orientation Tracking in a Ubiquitous Monitoring System for Parkinson Disease Patients With Freezing of Gait Symptom

Background Freezing of gait (FoG) is one of the most disturbing and least understood symptoms in Parkinson disease (PD). Although the majority of existing assistive systems assume accurate detections of FoG episodes, the detection itself is still an open problem. The specificity of FoG is its dependency on the context of a patient, such as the current location or activity. Knowing the patient's context might improve FoG detection. One of the main technical challenges that needs to be solved in order to start using contextual information for FoG detection is accurate estimation of the patient's position and orientation toward key elements of his or her indoor environment. Objective The objectives of this paper are to (1) present the concept of the monitoring system, based on wearable and ambient sensors, which is designed to detect FoG using the spatial context of the user, (2) establish a set of requirements for the application of position and orientation tracking in FoG detection, (3) evaluate the accuracy of the position estimation for the tracking system, and (4) evaluate two different methods for human orientation estimation. Methods We developed a prototype system to localize humans and track their orientation, as an important prerequisite for a context-based FoG monitoring system. To setup the system for experiments with real PD patients, the accuracy of the position and orientation tracking was assessed under laboratory conditions in 12 participants. To collect the data, the participants were asked to wear a smartphone, with and without known orientation around the waist, while walking over a predefined path in the marked area captured by two Kinect cameras with non-overlapping fields of view. Results We used the root mean square error (RMSE) as the main performance measure. The vision based position tracking algorithm achieved RMSE = 0.16 m in position estimation for upright standing people. The experimental results for the proposed human orientation estimation methods demonstrated the adaptivity and robustness to changes in the smartphone attachment position, when the fusion of both vision and inertial information was used. Conclusions The system achieves satisfactory accuracy on indoor position tracking for the use in the FoG detection application with spatial context. The combination of inertial and vision information has the potential for correct patient heading estimation even when the inertial wearable sensor device is put into an a priori unknown position.

[1]  Brian L. Day,et al.  Doorway‐provoked freezing of gait in Parkinson's disease , 2012, Movement disorders : official journal of the Movement Disorder Society.

[2]  Matthias Rauterberg,et al.  Ambient Sensor System for Freezing of Gait Detection by Spatial Context Analysis , 2012, IWAAL.

[3]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[4]  E. Jovanov,et al.  deFOG — A real time system for detection and unfreezing of gait of Parkinson’s patients , 2009, 2009 Annual International Conference of the IEEE Engineering in Medicine and Biology Society.

[5]  W. Ondo,et al.  Ambulatory monitoring of freezing of gait in Parkinson's disease , 2008, Journal of Neuroscience Methods.

[6]  F. Horak,et al.  Step initiation in Parkinson's disease: Influence of levodopa and external sensory triggers , 1997, Movement disorders : official journal of the Movement Disorder Society.

[7]  Joan Cabestany,et al.  Time series analysis of inertial-body signals for the extraction of dynamic properties from human gait , 2010, The 2010 International Joint Conference on Neural Networks (IJCNN).

[8]  Morgan Quigley,et al.  ROS: an open-source Robot Operating System , 2009, ICRA 2009.

[9]  S Fahn,et al.  The freezing phenomenon in parkinsonism. , 1995, Advances in neurology.

[10]  Marten Munneke,et al.  Clinimetrics of freezing of gait , 2008, Movement disorders : official journal of the Movement Disorder Society.

[11]  Ulrich Weidmann,et al.  Transporttechnik der Fussgänger , 1992 .

[12]  Adso Fernández-Baena,et al.  Biomechanical Validation of Upper-Body and Lower-Body Joint Movements of Kinect Motion Capture Data for Rehabilitation Treatments , 2012, 2012 Fourth International Conference on Intelligent Networking and Collaborative Systems.

[13]  James M Shine,et al.  The specific contributions of set‐shifting to freezing of gait in Parkinson's disease , 2010, Movement disorders : official journal of the Movement Disorder Society.

[14]  Jeffrey M. Hausdorff,et al.  Wearable Assistant for Parkinson’s Disease Patients With the Freezing of Gait Symptom , 2010, IEEE Transactions on Information Technology in Biomedicine.

[15]  Luiz Velho,et al.  Kinect and RGBD Images: Challenges and Applications , 2012, 2012 25th SIBGRAPI Conference on Graphics, Patterns and Images Tutorials.

[16]  Matthias Rauterberg,et al.  A System for Inference of Spatial Context of Parkinson's Disease Patients , 2012, pHealth.

[17]  Q. Almeida,et al.  Freezing of gait in Parkinson's disease: a perceptual cause for a motor impairment? , 2009, Journal of Neurology, Neurosurgery & Psychiatry.

[18]  Thierry Keller,et al.  Gait analysis in frequency domain for freezing detection in patients with Parkinson’s disease , 2008 .

[19]  Michael E. Cinelli,et al.  Locomotion through apertures when wider space for locomotion is necessary: adaptation to artificially altered bodily states , 2006, Experimental Brain Research.

[20]  H. Ellgring,et al.  Predictors of freezing in Parkinson's disease: A survey of 6,620 patients , 2007, Movement disorders : official journal of the Movement Disorder Society.

[21]  Jeffrey M. Hausdorff,et al.  Falls and freezing of gait in Parkinson's disease: A review of two interconnected, episodic phenomena , 2004, Movement disorders : official journal of the Movement Disorder Society.

[22]  Alice Nieuwboer,et al.  Cueing for freezing of gait in patients with Parkinson's disease: A rehabilitation perspective , 2008, Movement disorders : official journal of the Movement Disorder Society.

[23]  Wolfram Burgard,et al.  Probabilistic Robotics (Intelligent Robotics and Autonomous Agents) , 2005 .

[24]  Nir Giladi,et al.  Characterization of freezing of gait subtypes and the response of each to levodopa in Parkinson's disease , 2003, European journal of neurology.

[25]  Michael Harville,et al.  Fast, integrated person tracking and activity recognition with plan-view templates from a single stereo camera , 2004, CVPR 2004.

[26]  Radu Bogdan Rusu,et al.  3D is here: Point Cloud Library (PCL) , 2011, 2011 IEEE International Conference on Robotics and Automation.

[27]  Rafael Muñoz-Salinas,et al.  A Bayesian plan-view map based approach for multiple-person detection and tracking , 2008, Pattern Recognit..

[28]  V. Pisarevsky,et al.  Intel's Computer Vision Library: applications in calibration, stereo segmentation, tracking, gesture, face and object recognition , 2000, Proceedings IEEE Conference on Computer Vision and Pattern Recognition. CVPR 2000 (Cat. No.PR00662).

[29]  Sebastian Madgwick,et al.  Estimation of IMU and MARG orientation using a gradient descent algorithm , 2011, 2011 IEEE International Conference on Rehabilitation Robotics.

[30]  Sinziana Mazilu,et al.  Online detection of freezing of gait with smartphones and machine learning techniques , 2012, 2012 6th International Conference on Pervasive Computing Technologies for Healthcare (PervasiveHealth) and Workshops.

[31]  Michael Harville,et al.  Stereo person tracking with short and long term plan-view appearance models of shape and color , 2005, IEEE Conference on Advanced Video and Signal Based Surveillance, 2005..

[32]  Kaat Desloovere,et al.  Freezing of gait in Parkinson's disease: The impact of dual‐tasking and turning , 2010, Movement disorders : official journal of the Movement Disorder Society.

[33]  Jeffrey M. Hausdorff,et al.  The role of mental function in the pathogenesis of freezing of gait in Parkinson's disease , 2006, Journal of the Neurological Sciences.

[34]  Nicole Wenderoth,et al.  Freezing in Parkinson's disease: A spatiotemporal motor disorder beyond gait , 2012, Movement disorders : official journal of the Movement Disorder Society.

[35]  Maja Relja Treatment of advanced Parkinson's disease , 2011 .