Automated Detection of Movements During Sleep Using a 3D Time-of-Flight Camera: Design and Experimental Evaluation

Analyses of sleep-related movement disorders have gained importance due to an increase in life expectancy. The present approaches for measuring movements are based on electromyography or accelerometry and provide only local or specific results from muscles/limbs to which sensors have been attached. The motivation of this work was to investigate the detection of a more complete spectrum of sleep-related movements using a three-dimensional (3D) camera instead of the current conventional methods. In contrast to most of the previously published literature, this method allows for the detection of movements even when patients are covered with a blanket. This is the first work to evaluate movement detection with a clinical dataset and replicate the clinical environment in a laboratory setup. The laboratory setup allowed for the characterization of detectable movements through the determination of speed and amplitude limits. We used the Kinect One time-of-flight sensor to record 3D videos. Movements were quantified based on the temporal depth change in these 3D videos. A computer-controlled lifting table allowed for the controlled simulation of movements. Our algorithm detected movements with amplitude values >3.0 mm and velocity values >3.5 mm/s with an F1 score ≥95%. The shortest reliably detected duration of movement was 350 ms. In an ethically approved clinical study including 44 patients, 93.1% of electromyography-detected leg movements were also found in 3D. A significant correlation ( $\rho = 0.86$ ) was found between movements detected by the 3D system and polysomnography. The 3D system detected 31.2% more movements than electromyography. In addition to obtaining a broader spectrum of movements not limited to local and muscle/limb-specific movements, the usage of a contactless 3D camera simplifies the recording setup and preserves natural sleeping behavior. The presented 3D system may become useful for diagnostic purposes during sleep studies.