Markerless estimation of patient orientation, posture and pose using range and pressure imaging

PurposeIn diagnostic tomographic imaging, patient setup and scanner initialization is a manual, tedious procedure in clinical practice. A fully-automatic detection of the patient’s position, orientation, posture and pose on the patient table holds great potential for optimizing this part of the imaging workflow. We propose a markerless framework that is capable of extracting this information within seconds from either range imaging (RI) or pressure imaging (PI) data.MethodsThe proposed method is composed of three stages: First, the position and orientation of the reclined patient are determined. Second, the patient’s posture is classified. Third, based on the estimated orientation and posture, an approximate body pose is recovered by fitting an articulated model to the observed RI/PI data. Being a key issue for clinical application, our approach does not require an initialization pose.ResultsIn a case study on real data from 16 subjects, the performance of the proposed system was evaluated quantitatively with a 3-D time-of-flight RI camera and a pressure sensing mattress (PI). The patient orientation was successfully determined for all subjects, independent of the modality. At the posture recognition stage, our method achieved mean classification rates of 79.4% for RI and 95.5% for PI data, respectively. Concerning the approximate body pose estimation, anatomical body landmarks were localized with an accuracy of ±5.84cm (RI) and ±5.53cm (PI).ConclusionsThe results indicate that an estimation of the patient’s position, orientation, posture and pose using RI and PI sensors, respectively, is feasible, and beneficial for optimizing the workflow in diagnostic tomographic imaging. Both modalities achieved comparable pose estimation results using different models that account for modality-specific characteristics. PI outperforms RI in discriminating between prone and supine postures due to the distinctive pressure distribution of the human body.

[1]  David E. Goldberg,et al.  Genetic Algorithms in Search Optimization and Machine Learning , 1988 .

[2]  Ronald Poppe,et al.  Vision-based human motion analysis: An overview , 2007, Comput. Vis. Image Underst..

[3]  Tomomasa Sato,et al.  Pressure distribution image based human motion tracking system using skeleton and surface integration model , 2001, Proceedings 2001 ICRA. IEEE International Conference on Robotics and Automation (Cat. No.01CH37164).

[4]  Adrian Hilton,et al.  A survey of advances in vision-based human motion capture and analysis , 2006, Comput. Vis. Image Underst..

[5]  Thomas P Andriacchi,et al.  The evolution of methods for the capture of human movement leading to markerless motion capture for biomechanical applications , 2006, Journal of NeuroEngineering and Rehabilitation.

[6]  Andrew Hunter,et al.  Erratum to: Robust Pose Recognition of the Obscured Human Body , 2011, International Journal of Computer Vision.

[7]  Nassir Navab,et al.  Patient Position Detection for SAR Optimization in Magnetic Resonance Imaging , 2006, MICCAI.

[8]  Ju-Jang Lee,et al.  Intelligent Bed Robot System: Pose Estimation Using Sensor Distribution Mattress , 2004, 2004 IEEE International Conference on Robotics and Biomimetics.

[9]  Thomas Martinetz,et al.  Self-Organizing Maps for Pose Estimation with a Time-of-Flight Camera , 2009, Dyn3D.

[10]  Nassir Navab,et al.  Manifold learning for patient position detection in MRI , 2010, 2010 IEEE International Symposium on Biomedical Imaging: From Nano to Macro.

[11]  Rüdiger Dillmann,et al.  Fusion of 2d and 3d sensor data for articulated body tracking , 2009, Robotics Auton. Syst..

[12]  Tomomasa Sato,et al.  Body parts positions and posture estimation system based on pressure distribution image , 1999, Proceedings 1999 IEEE International Conference on Robotics and Automation (Cat. No.99CH36288C).

[13]  Matthias Fenchel,et al.  Automatic Labeling of Anatomical Structures in MR FastView Images Using a Statistical Atlas , 2008, MICCAI.

[14]  Joachim Hornegger,et al.  Inverse C-arm Positioning for Interventional Procedures Using Real-Time Body Part Detection , 2009, MICCAI.

[15]  Rasmus Larsen,et al.  Analysis of Gait Using a Treadmill and a Time-of-Flight Camera , 2009, Dyn3D.

[16]  Reinhard Koch,et al.  Time-of-Flight Sensors in Computer Graphics , 2009, Eurographics.

[17]  Thomas Gärtner,et al.  Efficient co-regularised least squares regression , 2006, ICML.

[18]  Behzad Dariush,et al.  Controlled human pose estimation from depth image streams , 2008, 2008 IEEE Computer Society Conference on Computer Vision and Pattern Recognition Workshops.