Contact-Free Pulse Signal Extraction from Human Face Videos: A Review and New Optimized Filtering Approach

Muhammad Waqar, Reyer Zwiggelaar, Bernard Tiddeman*

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In this chapter, we review methods for video-based heart monitoring, from classical signal processing approaches to modern deep learning methods. In addition, we propose a new method for learning an optimal filter that can overcome many of the problems that can affect classical approaches, such as light reflection and subject’s movements, at a fraction of the training cost of deep learning approaches. Following the usual procedures for region of interest extraction and tracking, robust skin color estimation and signal pre-processing, we introduce a least-squares error optimal filter, learnt using an established training dataset to estimate the photoplethysmographic (PPG) signal more accurately from the measured color changes over time. This method not only improves the accuracy of heart rate measurement but also resulted in the extraction of a cleaner pulse signal, which could be integrated into many other useful applications such as human biometric recognition or recognition of emotional state. The method was tested on the DEAP dataset and showed improved performance over the best previous classical method on that dataset. The results obtained show that our proposed contact-free heart rate measurement method has significantly improved on existing methods.

Original languageEnglish
Title of host publicationAdvances in Experimental Medicine and Biology
EditorsPaul M. Rea
PublisherSpringer Nature
Chapter10
Pages181-202
Number of pages22
Volume9
Edition1
ISBN (Electronic)9783030611255
ISBN (Print)9783030611248, 9783030611279
DOIs
Publication statusPublished - 2021

Publication series

NameAdvances in Experimental Medicine and Biology
Volume1317
ISSN (Print)0065-2598
ISSN (Electronic)2214-8019

Keywords

  • Deep learning
  • Optimal Fourier domain filter
  • Video photoplenthysmography (PPG)
  • Heart Rate
  • Algorithms
  • Humans
  • Signal Processing, Computer-Assisted
  • Face
  • Biometry

Fingerprint

Dive into the research topics of 'Contact-Free Pulse Signal Extraction from Human Face Videos: A Review and New Optimized Filtering Approach'. Together they form a unique fingerprint.

Cite this