Towards Pain Monitoring: Facial Expression, Head Pose, a new Database, an Automatic System and Remaining

Pain is what the patient says it is. But what about these who cannot utter? Automatic pain monitoring opens up prospects for better treatment, but accurate assessment of pain is challenging due to the subjective nature of pain. To facilitate advances, we contribute a new dataset, the BioVid Heat Pain Database which contains videos and physiological data of 90 persons subjected to well-defined pain stimuli of 4 intensities. We propose a fully automatic recognition system utilizing facial expression, head pose information and their dynamics. The approach is evaluated with the task of pain detection on the new dataset, also outlining open challenges for pain monitoring in general. Additionally, we analyze the relevance of head pose information for pain recognition and compare person-specific and general classification models.

[1]  M. Berger,et al.  Pain in elderly people with severe dementia: A systematic review of behavioural pain assessment tools , 2006, BMC geriatrics.

[2]  Luc Van Gool,et al.  Real Time Head Pose Estimation from Consumer Depth Cameras , 2011, DAGM-Symposium.

[3]  Peter H. Tu,et al.  Person-specific expression recognition with transfer learning , 2012, 2012 19th IEEE International Conference on Image Processing.

[4]  Ayoub Al-Hamadi,et al.  Emotion Recognition based on 2D-3D Facial Feature Extraction from Color Image Sequences , 2010, J. Multim..

[5]  Thomas Hadjistavropoulos,et al.  Pain: Psychological Perspectives , 2004 .

[6]  Andrew Moore,et al.  Fortnightly review: Treating acute pain in hospital , 1997 .

[7]  John R. Satterthwaite,et al.  Handbook of Pain Management , 1994 .

[8]  Ayoub Al-Hamadi,et al.  Pain recognition and intensity rating based on Comparative Learning , 2012, 2012 19th IEEE International Conference on Image Processing.

[9]  K. Prkachin.  The consistency of facial expressions of pain: a comparison across modalities , 1992, Pain.

[10]  Mohan M. Trivedi,et al.  Head Pose Estimation in Computer Vision: A Survey , 2009, IEEE Transactions on Pattern Analysis and Machine Intelligence.

[11]  B. Michaelis,et al.  Facial expression recognition based on Haar-like feature detection , 2008, Pattern Recognition and Image Analysis.

[12]  Rainer Lienhart,et al.  Empirical Analysis of Detection Cascades of Boosted Classifiers for Rapid Object Detection , 2003, DAGM-Symposium.

[13]  Jeffrey F. Cohn,et al.  Painful monitoring: Automatic pain monitoring using the UNBC-McMaster shoulder pain expression archive database , 2012, Image Vis. Comput..

[14]  Oscar Déniz-Suárez,et al.  ENCARA2: Real-time detection of multiple faces at different resolutions in video streams , 2007, J. Vis. Commun. Image Represent..

[15]  Miriam Kunz,et al.  Impact of age on the facial expression of pain. , 2008, Journal of psychosomatic research.

[16]  Amanda C.C. Williams,et al.  Simple pain rating scales hide complex idiosyncratic meanings , 2000, Pain.

[17]  Ayoub Al-Hamadi,et al.  A Stereo and Color-based Method for Face Pose Estimation and Facial Feature Extraction , 2006, 18th International Conference on Pattern Recognition (ICPR'06).

[18]  Chih-Jen Lin,et al.  LIBSVM: A library for support vector machines , 2011, TIST.

[19]  Gwen Littlewort,et al.  Automatic coding of facial expressions displayed during posed and genuine pain , 2009, Image Vis. Comput..

[20]  Zhihong Zeng,et al.  A Survey of Affect Recognition Methods: Audio, Visual, and Spontaneous Expressions , 2009, IEEE Trans. Pattern Anal. Mach. Intell..

[21]  A. Unruh,et al.  Pain: A Textbook for Therapists , 2001 .

[22]  H. Kehlet,et al.  Acute pain control and accelerated postoperative surgical recovery. , 1999, The Surgical clinics of North America.

[23]  Zakia Hammal,et al.  Pain monitoring: A dynamic and context-sensitive system , 2012, Pattern Recognit..

[24]  Yiming Yang,et al.  An Evaluation of Statistical Approaches to Text Categorization , 1999, Information Retrieval.

[25]  Ayoub Al-Hamadi,et al.  Towards Pain Recognition in Post-Operative Phases Using 3D-based Features From Video and Support Vector Machines , 2009, J. Digit. Content Technol. its Appl..

[26]  Jeffrey F. Cohn,et al.  Automatic detection of pain intensity , 2012, ICMI '12.