A Morphable Face Albedo Model

William Smith, Alassane Seck, Hannah Dee, Bernard Tiddeman, Joshua Tenenbaum, Bernhard Egger

Allbwn ymchwil: Pennod mewn Llyfr/Adroddiad/Trafodion CynhadleddTrafodion Cynhadledd (Nid-Cyfnodolyn fathau)

30 Dyfyniadau(SciVal)
124 Wedi eu Llwytho i Lawr (Pure)

Crynodeb

In this paper, we bring together two divergent strands of research: photometric face capture and statistical 3D face appearance modelling. We propose a novel lightstage capture and processing pipeline for acquiring ear-to-ear, truly intrinsic diffuse and specular albedo maps that fully factor out the effects of illumination, camera and geometry. Using this pipeline, we capture a dataset of 50 scans and combine them with the only existing publicly available albedo dataset (3DRFE) of 23 scans. This allows us to build the first morphable face albedo model. We believe this is the first statistical analysis of the variability of facial specular albedo maps. This model can be used as a plug in replacement for the texture model of the Basel Face Model and we make our new albedo model publicly available. We ensure careful spectral calibration such that our model is built in a linear sRGB space, suitable for inverse rendering of images taken by typical cameras. We demonstrate our model in a state of the art analysis-by-synthesis 3DMM fitting pipeline, are the first to integrate specular map estimation and outperform the Basel Face Model in albedo reconstruction.
Iaith wreiddiolSaesneg
Teitl2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)
Tudalennau5010-5019
Nifer y tudalennau10
Dynodwyr Gwrthrych Digidol (DOIs)
StatwsCyhoeddwyd - 14 Meh 2020
DigwyddiadIEEE/CVF Conference on Computer Vision and Pattern Recognition - Online, Seattle, Unol Daleithiau America
Hyd: 14 Meh 202019 Meh 2020
http://cvpr2020.thecvf.com/

Cyfres gyhoeddiadau

EnwProceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
ISSN (Argraffiad)1063-6919

Cynhadledd

CynhadleddIEEE/CVF Conference on Computer Vision and Pattern Recognition
Teitl crynoCVPR
Gwlad/TiriogaethUnol Daleithiau America
DinasSeattle
Cyfnod14 Meh 202019 Meh 2020
Cyfeiriad rhyngrwyd

Ôl bys

Gweld gwybodaeth am bynciau ymchwil 'A Morphable Face Albedo Model'. Gyda’i gilydd, maen nhw’n ffurfio ôl bys unigryw.

Dyfynnu hyn