Advanced Statistical Analysis of 3D Kinect Data: A Comparison of the Classification Methods

This paper focuses on the statistical analysis of mimetic muscle rehabilitation after head and neck surgery causing facial paresis in patients after head and neck surgery. Our work deals with an evaluation problem of mimetic muscle rehabilitation that is observed by a Kinect stereo-vision camera. After a specific brain surgery, patients are often affected by face palsy, and rehabilitation to renew mimetic muscle innervation takes several months. It is important to be able to observe the rehabilitation process in an objective way. The most commonly used House–Brackmann (HB) scale is based on the clinician’s subjective opinion. This paper compares different methods of supervised learning classification that should be independent of the clinician’s opinion. We compare a parametric model (based on logistic regression), non-parametric model (based on random forests), and neural networks. The classification problem that we have studied combines a limited dataset (it contains only 122 measurements of 93 patients) of complex observations (each measurement consists of a collection of time curves) with an ordinal response variable. To balance the frequencies of the considered classes in our data set, we reclassified the samples from HB4 to HB3 and HB5 to HB6—it means that only four HB grades are used for classification algorithm. The parametric statistical model was found to be the most suitable thanks to its stability, tractability, and reasonable performance in terms of both accuracy and precision.

[1]  Scott L. Zeger,et al.  Clinical risk prediction with random forests for survival, longitudinal, and multivariate (RF-SLAM) data analysis , 2019, BMC Medical Research Methodology.

[2]  Yoshua Bengio,et al.  On the Properties of Neural Machine Translation: Encoder–Decoder Approaches , 2014, SSST@EMNLP.

[3]  Caroline F Finch,et al.  Applications of functional data analysis: A systematic review , 2013, BMC Medical Research Methodology.

[4]  J. W. House,et al.  Facial Nerve Grading System , 1985, Otolaryngology--head and neck surgery : official journal of American Academy of Otolaryngology-Head and Neck Surgery.

[5]  Aleš Procházka,et al.  Motion Symmetry Evaluation Using Accelerometers and Energy Distribution , 2019, Symmetry.

[6]  Bambang Parmanto,et al.  Systematic Review of Mobile Health Applications in Rehabilitation. , 2019, Archives of physical medicine and rehabilitation.

[7]  Zenghui Wang,et al.  Deep Convolutional Neural Networks for Image Classification: A Comprehensive Review , 2017, Neural Computation.

[8]  Manuel Febrero-Bande,et al.  Statistical Computing in Functional Data Analysis: The R Package fda.usc , 2012 .

[9]  A. Mäkitie,et al.  Facial nerve electrodiagnostics for patients with facial palsy: a clinical practice guideline , 2020, European Archives of Oto-Rhino-Laryngology.

[10]  A. Gharabaghi,et al.  Interobserver variability of the House-Brackmann facial nerve grading system for the analysis of a randomized multi-center phase III trial , 2017, Acta Neurochirurgica.

[11]  K. Kennelly Electrodiagnostic approach to cranial neuropathies. , 2012, Neurologic clinics.

[12]  Jan Mareš,et al.  Advanced Statistical Analysis of 3D Kinect Data: Mimetic Muscle Rehabilitation Following Head and Neck Surgeries Causing Facial Paresis , 2020, Sensors.

[13]  Y. Ducic,et al.  Facial Nerve Trauma: Evaluation and Considerations in Management , 2015, Craniomaxillofacial trauma & reconstruction.

[14]  P. Urban,et al.  The Diagnosis and Treatment of Idiopathic Facial Paresis (Bell's Palsy). , 2019, Deutsches Arzteblatt international.

[15]  Owen P. Leary,et al.  3D-Printed Anatomic Modeling for Surgical Planning and Real-Time Operative Guidance in Complex Primary Spinal Column Tumors: Single-Center Experience and Case Series. , 2020, World neurosurgery.

[16]  Mohanasankar Sivaprakasam,et al.  Application of MEMS technology and engineering in medicine: a new paradigm for facial muscle reanimation , 2008, Expert review of medical devices.

[17]  Morteza Heidari,et al.  Applying a random projection algorithm to optimize machine learning model for predicting peritoneal metastasis in gastric cancer patients using CT images , 2020, Comput. Methods Programs Biomed..

[18]  O. Guntinas-Lichius,et al.  Contemporary Management of Benign and Malignant Parotid Tumors , 2018, Front. Surg..

[19]  M. Z. Naser,et al.  Error Metrics and Performance Fitness Indicators for Artificial Intelligence and Machine Learning in Engineering and Sciences , 2020, Architecture, Structures and Construction.

[20]  Roman Hornung,et al.  Ordinal Forests , 2020, J. Classif..

[21]  Nicolas Vayatis,et al.  Template-Based Step Detection with Inertial Measurement Units , 2018, Sensors.

[22]  James A. Owusu,et al.  Facial Nerve Paralysis. , 2018, The Medical clinics of North America.

[23]  Syed Muhammad Anwar,et al.  Medical Image Analysis using Convolutional Neural Networks: A Review , 2017, Journal of Medical Systems.

[24]  Hans-Georg Müller Functional Data Analysis. , 2011 .

[25]  Mara W Robinson,et al.  Facial Rehabilitation: Evaluation and Treatment Strategies for the Patient with Facial Palsy. , 2018, Otolaryngologic clinics of North America.

[26]  J. Nedzelski,et al.  Development of a sensitive clinical facial grading system. , 1996, European archives of oto-rhino-laryngology : official journal of the European Federation of Oto-Rhino-Laryngological Societies (EUFOS) : affiliated with the German Society for Oto-Rhino-Laryngology - Head and Neck Surgery.

[27]  Martin Schätz,et al.  Sleep Apnea Detection with Polysomnography and Depth Sensors , 2020, Sensors.