Psychological Stress Detection by 2D and 3D Facial Image Processing

This work aims to identify people psychological stress through the capture of micro modifications and motions within their facial expression. Exogenous and endogenous causes of stress, from environment and/or psychological conditions that could induce stress, have been reproduced in the experimental test involving real subjects, and their face expressions have been recorded by 2D and 3D image capturing tools to create a sample of emotional database. Successively, 2D and 3D analyses have been performed on recorded data according to the respective protocols, by deep learning and machine learning techniques, and a data driven model of the databases has been developed by neural network approach, to classify the psycho-behavioral answers to the different kinds of stress conditions induced on tested people. The ultimate aim of the study is to demonstrate the possibility to analyze data collected on participants from 2D shooting and 3D scans in a consistent way by means of deep learning and machine learning techniques, so that to provide a methodology to identify and classify some of the subtle facial micro-expressions of people involved in stressing activities.

[1]  Francesca Nonis,et al.  3D geometry-based face recognition in presence of eye and mouth occlusions , 2019, International Journal on Interactive Design and Manufacturing (IJIDeM).

[2]  P. Ekman,et al.  Unmasking the face : a guide to recognizing emotions from facial clues , 1975 .

[3]  Jean-Philippe Thiran,et al.  Detecting emotional stress from facial expressions for driving safety , 2014, 2014 IEEE International Conference on Image Processing (ICIP).

[4]  Alexander G. Hauptmann,et al.  Towards Independent Stress Detection: A Dependent Model Using Facial Action Units , 2018, 2018 International Conference on Content-Based Multimedia Indexing (CBMI).

[5]  Takeo Kanade,et al.  Recognizing Action Units for Facial Expression Analysis , 2001, IEEE Trans. Pattern Anal. Mach. Intell..

[6]  Stefano Tornincasa,et al.  3D geometry-based automatic landmark localization in presence of facial occlusions , 2017, Multimedia Tools and Applications.

[7]  J. Singer,et al.  Cognitive, social, and physiological determinants of emotional state. , 1962 .