Thermal Facial Analysis for Deception Detection

Bashar Ahmad Al-Rjoub, Reyer Zwiggelaar

Research output: Contribution to journalArticlepeer-review

82 Citations (SciVal)
144 Downloads (Pure)

Abstract

Thermal imaging technology can be used to detect stress levels in humans based on the radiated heat from their face. In this paper, we use thermal imaging to monitor the periorbital region’s thermal variations and test whether it can offer a discriminative signature for detecting deception. We start by presenting an overview on automated deception detection and propose a novel methodology, which we validate experimentally on 492 thermal responses (249 lies and 243 truths) extracted from 25 participants. The novelty of this paper lies in scoring a larger number of questions per subject, emphasizing a within-person approach for learning from data, proposing a framework for validating the decision making process, and correct evaluation of the generalization performance. A k-nearest neighbor classifier was used to classify the thermal responses using different strategies for data representation. We report an 87% ability to predict the lie/truth responses based on a within-person methodology and fivefold cross validation. Our results also show that the between person approach for modeling deception does not generalize very well across the training data.
Original languageEnglish
Pages (from-to)1015-1023
Number of pages9
JournalIEEE Transactions on Information Forensics and Security
Volume9
Issue number6
Early online date14 Apr 2014
DOIs
Publication statusPublished - 08 May 2014

Fingerprint

Dive into the research topics of 'Thermal Facial Analysis for Deception Detection'. Together they form a unique fingerprint.

Cite this