Diagnostic Criteria for Depression based on Both Static and Dynamic Visual Features

The mood disease depression is quite severe. Those who suffer from depression are often unable to function normally and may even resort to suicide if their condition worsens. Clinical interviews and questionnaires are now used in all cases of depression diagnosis, although these procedures are very subjective and lack objectivity and physiological basis. By calculating Beck Depression Inventory II (BDI-II) values from video data, we present an objective and non-discriminatory technique for depression diagnosis in this study. First, we use the LBP-TOP and EVLBP algorithms to extract a dynamic feature from each frame of the movie separately. The LBP operator is applied to each frame, HOG features are extracted from the LBP picture, and finally the LBP-HOG features are transformed into histogram vectors using BOW. Finally, the Gradient Boosting Regression is used to the combined dynamic and static characteristics to calculate the BDI-II. Using the AVEC 2014 depression dataset as an example, our tests demonstrate the efficacy of our suggested method.

[1]  Jingjie Yan,et al.  Micro-expression recognition using local binary pattern from five intersecting planes , 2022, Multimedia Tools and Applications.

[2]  Guodong Guo,et al.  Automated Depression Diagnosis Based on Deep Networks to Encode Facial Appearance and Dynamics , 2018, IEEE Transactions on Affective Computing.

[3]  Guodong Guo,et al.  Video-Based Depression Level Analysis by Encoding Deep Spatiotemporal Features , 2018, IEEE Transactions on Affective Computing.

[4]  Fan Zhang,et al.  Artificial Intelligent System for Automatic Depression Level Analysis Through Visual and Vocal Expressions , 2018, IEEE Transactions on Cognitive and Developmental Systems.

[5]  Dongmei Jiang,et al.  Multimodal depression recognition with dynamic visual and audio cues , 2015, 2015 International Conference on Affective Computing and Intelligent Interaction (ACII).

[6]  Xin Li,et al.  Automated Depression Diagnosis Based on Facial Dynamic Analysis and Sparse Coding , 2015, IEEE Transactions on Information Forensics and Security.

[7]  Björn W. Schuller,et al.  AVEC 2014: 3D Dimensional Affect and Depression Recognition Challenge , 2014, AVEC '14.

[8]  Fan Zhang,et al.  Automatic Depression Scale Prediction using Facial Expression Dynamics and Regression , 2014, AVEC '14.

[9]  Varun Jain,et al.  Depression Estimation Using Audiovisual Features and Fisher Vector Encoding , 2014, AVEC '14.

[10]  Albert Ali Salah,et al.  Ensemble CCA for Continuous Emotion Prediction , 2014, AVEC '14.

[11]  Josephine Sullivan,et al.  One millisecond face alignment with an ensemble of regression trees , 2014, 2014 IEEE Conference on Computer Vision and Pattern Recognition.

[12]  Heng Wang,et al.  Depression recognition based on dynamic facial and vocal expression features using partial least square regression , 2013, AVEC@ACM Multimedia.

[13]  Björn W. Schuller,et al.  AVEC 2013: the continuous audio/visual emotion and depression recognition challenge , 2013, AVEC@ACM Multimedia.

[14]  Thomas F. Quatieri,et al.  Vocal biomarkers of depression based on motor incoordination , 2013, AVEC@ACM Multimedia.

[15]  Roland Göcke,et al.  Diagnosis of depression by behavioural signals: a multimodal approach , 2013, AVEC@ACM Multimedia.

[16]  Michel F. Valstar,et al.  Local Gabor Binary Patterns from Three Orthogonal Planes for Automatic Facial Expression Recognition , 2013, 2013 Humaine Association Conference on Affective Computing and Intelligent Interaction.

[17]  F. Perronnin,et al.  Image Classification with the Fisher Vector: Theory and Practice , 2013, International Journal of Computer Vision.

[18]  Sidney K. D'Mello,et al.  Consistent but modest: a meta-analysis on unimodal and multimodal affect detection accuracies from 30 studies , 2012, ICMI '12.

[19]  Arnold W. M. Smeulders,et al.  Real-Time Visual Concept Classification , 2010, IEEE Transactions on Multimedia.

[20]  Nenghai Yu,et al.  Semantics-Preserving Bag-of-Words Models and Applications , 2010, IEEE Transactions on Image Processing.

[21]  Cordelia Schmid,et al.  Human Detection Using Oriented Histograms of Flow and Appearance , 2006, ECCV.

[22]  J. Friedman.  Greedy function approximation: A gradient boosting machine. , 2001 .

[23]  Maryam Zaffar,et al.  LBP–Bilateral Based Feature Fusion for Breast Cancer Diagnosis , 2022, Computers, Materials & Continua.

[24]  Ghulam Mustafa,et al.  Hybridization of CNN with LBP for Classification of Melanoma Images , 2022, Computers, Materials & Continua.

[25]  Habibollah Haron,et al.  Multi-Level Fusion in Ultrasound for Cancer Detection based on Uniform LBP Features , 2021 .

[26]  Michael J. Freeman,et al.  Motion history histograms for human action recognition , 2009 .