Lie Detection-Recovery of the Periorbital Signal through Tandem Tracking and Noise Suppression in Thermal Facial Video

Previous work has demonstrated the correlation of periorbital perfusion and stress levels in human beings. It has also been suggested that periorbital perfusion can be quantified through processing of thermal video. The idea has been based on the fact that skin temperature is heavily modulated by superficial blood perfusion. Proof of this concept was established for two different types of stress inducing experiments: startle and mockcrime polygraph interrogations. However, the polygraph interrogation scenarios were simplistic and highly constrained. In the present paper, we report results on a large and realistic mock-crime interrogation experiment. The interrogation is free flowing and no restrictions have been placed on the subjects. We propose a new methodology to compute the average periorbital temperature signal. The present approach addresses the deficiencies of the earlier methodology and is capable of coping with the challenges posed by the realistic setting. Specifically, it features a tandem condensation tracker to register the periorbital area in the context of a moving face. It operates on the raw temperature signal and tries to improve the information content by suppressing the noise level instead of amplifying the signal as a whole. Finally, a pattern recognition method classifies stressful (Deceptive) from non-stressful (Non-Deceptive) subjects based on a comparative measure between the interrogation signal (baseline) and portions thereof (transient response). The successful classification rate is 87.2% for 39 subjects. This is in par with the success rate achieved by highly trained psychophysiological experts and opens the way for automating lie detection in realistic settings.

[1]  J. Tukey,et al.  An algorithm for the machine calculation of complex Fourier series , 1965 .

[2]  Fred E. Inbau,et al.  Criminal Interrogation and Confessions , 1967 .

[3]  B Kleinmuntz,et al.  Lie detection in ancient and modern times. A call for contemporary scientific study. , 1984, The American psychologist.

[4]  P D Drummond,et al.  Facial flushing and sweating mediated by the sympathetic nervous system. , 1987, Brain : a journal of neurology.

[5]  D. Schacter.  Implicit memory: History and current status. , 1987 .

[6]  W. Banks.  Implicit Memory , 1995, Consciousness and Cognition.

[7]  R. Althoff.  Eye Movement-Based Memory Assessment: The Use of Eye Movement Monitoring as an Indirect Measure of Memory , 1998 .

[8]  N. J. Cohen,et al.  Eye-movement-based memory effect: a reprocessing effect in face perception. , 1999, Journal of experimental psychology. Learning, memory, and cognition.

[9]  Neal J. Cohen,et al.  Eye Movement-Based Memory Assessment , 1999 .

[10]  I. Pavlidis,et al.  Thermal imaging for anxiety detection , 2000, Proceedings IEEE Workshop on Computer Vision Beyond the Visible Spectrum: Methods and Applications (Cat. No.PR00640).

[11]  I. Pavlidis,et al.  Thermal image analysis for polygraph testing. , 2002, IEEE engineering in medicine and biology magazine : the quarterly magazine of the Engineering in Medicine & Biology Society.

[12]  Ioannis Pavlidis,et al.  Human behaviour: Seeing through the face of deception , 2002, Nature.

[13]  William H. Press,et al.  Numerical recipes in C , 2002 .

[14]  Lawrence B. Wolff,et al.  Tracking human faces in infrared video , 2003, Image Vis. Comput..

[15]  Michael Isard,et al.  CONDENSATION—Conditional Density Propagation for Visual Tracking , 1998, International Journal of Computer Vision.

[16]  Marc Garbey,et al.  A filtering technique for system of reaction–diffusion equations , 2006 .