Repurposing the Microsoft Kinect for Windows v2 for external head motion tracking for brain PET

Medical imaging systems such as those used in positron emission tomography (PET) are capable of spatial resolutions that enable the imaging of small, functionally important brain structures. However, the quality of data from PET brain studies is often limited by subject motion during acquisition. This is particularly challenging for patients with neurological disorders or with dynamic research studies that can last 90 min or more. Restraining head movement during the scan does not eliminate motion entirely and can be unpleasant for the subject. Head motion can be detected and measured using a variety of techniques that either use the PET data itself or an external tracking system. Advances in computer vision arising from the video gaming industry could offer significant benefits when re-purposed for medical applications. A method for measuring rigid body type head motion using the Microsoft Kinect v2 is described with results presenting  ⩽0.5 mm spatial accuracy. Motion data is measured in real-time at 30 Hz using the KinectFusion algorithm. Non-rigid motion is detected using the residual alignment energy data of the KinectFusion algorithm allowing for unreliable motion to be discarded. Motion data is aligned to PET listmode data using injected pulse sequences into the PET/CT gantry allowing for correction of rigid body motion. Pilot data from a clinical dynamic PET/CT examination is shown.

[1]  Marjorie Skubic,et al.  Unobtrusive, Continuous, In-Home Gait Measurement Using the Microsoft Kinect , 2013, IEEE Transactions on Biomedical Engineering.

[2]  Y. Picard,et al.  Motion correction of PET images using multiple acquisition frames , 1995, 1995 IEEE Nuclear Science Symposium and Medical Imaging Conference Record.

[3]  Andrew D. Wiles,et al.  Accuracy assessment and interpretation for optical tracking systems , 2004, Medical Imaging: Image-Guided Procedures.

[4]  J. Mazziotta,et al.  Rapid Automated Algorithm for Aligning and Reslicing PET Images , 1992, Journal of computer assisted tomography.

[5]  Dimitrios Makris,et al.  Fall detection system using Kinect’s infrared sensor , 2014, Journal of Real-Time Image Processing.

[6]  Anders Ettrup,et al.  Radiosynthesis and Evaluation of 11C-CIMBI-5 as a 5-HT2A Receptor Agonist Radioligand for PET , 2010, The Journal of Nuclear Medicine.

[7]  ZhangZhengyou.  A Flexible New Technique for Camera Calibration , 2000 .

[8]  Guy Marchal,et al.  Automated multi-moda lity image registration based on information theory , 1995 .

[9]  Darren Kahler,et al.  Characterization of a real-time surface image-guided stereotactic positioning system. , 2010, Medical physics.

[10]  Sander Oude Elberink,et al.  Accuracy and Resolution of Kinect Depth Data for Indoor Mapping Applications , 2012, Sensors.

[11]  Reinhard Koch,et al.  Time-of-Flight sensor calibration for accurate range sensing , 2010, Comput. Vis. Image Underst..

[12]  Paul A. Viola,et al.  Multi-modal volume registration by maximization of mutual information , 1996, Medical Image Anal..

[13]  Tim Weyrich,et al.  Capturing Time-of-Flight data with confidence , 2011, CVPR 2011.

[14]  Rasmus R. Paulsen,et al.  List-Mode PET Motion Correction Using Markerless Head Tracking: Proof-of-Concept With Scans of Human Subject , 2013, IEEE Transactions on Medical Imaging.

[15]  Andre Kyme,et al.  Markerless Motion Tracking of Awake Animals in Positron Emission Tomography , 2014, IEEE Transactions on Medical Imaging.

[16]  Zhengyou Zhang,et al.  A Flexible New Technique for Camera Calibration , 2000, IEEE Trans. Pattern Anal. Mach. Intell..

[17]  W. Schlegel,et al.  Accuracy of a commercial optical 3D surface imaging system for realignment of patients for radiotherapy of the thorax , 2007, Physics in medicine and biology.

[18]  H. Macher,et al.  FIRST EXPERIENCES WITH KINECT V2 SENSOR FOR CLOSE RANGE 3D MODELLING , 2015 .

[19]  B. Lopresti,et al.  Implementation and performance of an optical motion tracking system for high resolution brain PET imaging , 1998, 1998 IEEE Nuclear Science Symposium Conference Record. 1998 IEEE Nuclear Science Symposium and Medical Imaging Conference (Cat. No.98CH36255).

[20]  Hilmar Ingensand,et al.  Calibration of the fast range imaging camera SwissRanger for use in the surveillance of the environment , 2006, SPIE Security + Defence.

[21]  Francisco José Madrid-Cuevas,et al.  Automatic generation and detection of highly reliable fiducial markers under occlusion , 2014, Pattern Recognit..

[22]  Guy Marchal,et al.  Automated multi-modality image registration based on information theory , 1995 .

[23]  Andrew W. Fitzgibbon,et al.  KinectFusion: Real-time dense surface mapping and tracking , 2011, 2011 10th IEEE International Symposium on Mixed and Augmented Reality.

[24]  Roger Fulton,et al.  The design and implementation of a motion correction scheme for neurological PET. , 2003, Physics in medicine and biology.

[25]  Jon Howard,et al.  Realtime markerless rigid body head motion tracking using the Microsoft Kinect , 2012, 2012 IEEE Nuclear Science Symposium and Medical Imaging Conference Record (NSS/MIC).