Automatic 3D face reconstruction from single images or video

Pia Breuer, Kwang- In Kim, Wolf Kienzle, Bernhard Schölkopf, Volker Blanz

Research output: Chapter in Book/Report/Conference proceedingConference contribution

34 Citations (Scopus)

Abstract

This paper presents a fully automated algorithm for reconstructing a textured 3D model of a face from a single photograph or a raw video stream. The algorithm is based on a combination of Support Vector Machines (SVMs) and a Morphable Model of 3D faces. After SVM face detection, individual facial features are detected using a novel regression- and classification-based approach, and probabilistically plausible configurations of features are selected to produce a list of candidates for several facial feature positions. In the next step, the configurations of feature points are evaluated using a novel criterion that is based on a Morphable Model and a combination of linear projections. To make the algorithm robust with respect to head orientation, this process is iterated while the estimate of pose is refined. Finally, the feature points initialize a model-fitting procedure of the Morphable Model. The result is a high resolution 3D surface model.
Original languageEnglish
Title of host publicationProc. IEEE International Conference on Automatic Face & Gesture Recognition, 2008
PublisherIEEE
Pages1-8
Number of pages8
ISBN (Print)9781424421541
DOIs
Publication statusPublished - 2008
Event8th International Conference on Automatic Face & Gesture Recognition (FG 08), 2008 - Amsterdam, Netherlands
Duration: 17 Sep 200819 Sep 2008

Conference

Conference8th International Conference on Automatic Face & Gesture Recognition (FG 08), 2008
CountryNetherlands
CityAmsterdam
Period17/09/0819/09/08

Fingerprint Dive into the research topics of 'Automatic 3D face reconstruction from single images or video'. Together they form a unique fingerprint.

Cite this