Facial Capture and Animation in Visual Effects

Research output: Chapter in Book/Report/Conference proceedingChapter

Abstract

In recent years, there has been increasing interest in facial animation re- search from both academia and the entertainment industry. Visual effects and video game companies both want to deliver new audience experiences – whether that is a hyper-realistic human character [Duncan 09] or a fantasy creature driven by a human performer [Duncan 10]. Having more efficient ways of delivering high quality animation, as well as increasing the visual realism of performances, has motivated a surge of innovative academic and industrial developments.
Central to many of these developments are key technical advances in computer vision and graphics. Of particular note are advances in multi- view stereo reconstruction, facial tracking and motion capture, dense non- rigid registration of meshes, measurement of skin rendering attributes (e.g. BRDFs for skin and skin subsurface scattering models) and sensing tech- nology.
This chapter builds on concepts already described earlier in this book – such as 3D capture, rigging, and non-rigid registration – and takes a more practical look at how they might typically be applied in visual effects. First, methods and applications for facial static capture and rendering are considered, before dynamic capture is addressed. Finally, a case study is examined called The Gathering involving the creation of an animated face – from animation to final composite.
LanguageEnglish
Title of host publicationDigital Representations of the Real World: How to Capture, Model, and Render Visual Reality
EditorsOlga Sorkine, Marcus Magnor, Oliver Grau, Christian Theobalt
PublisherCRC Press
Pages311-321
Number of pages10
ISBN (Electronic)978-1482243819
ISBN (Print)1482243814
StatusPublished - 7 May 2015

Fingerprint

Animation
Skin
Computer graphics
Computer vision
Industry
Scattering
Composite materials

Cite this

Cosker, D. (2015). Facial Capture and Animation in Visual Effects. In O. Sorkine, M. Magnor, O. Grau, & C. Theobalt (Eds.), Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality (pp. 311-321). CRC Press.

Facial Capture and Animation in Visual Effects. / Cosker, Darren.

Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality. ed. / Olga Sorkine; Marcus Magnor; Oliver Grau; Christian Theobalt. CRC Press, 2015. p. 311-321.

Research output: Chapter in Book/Report/Conference proceedingChapter

Cosker, D 2015, Facial Capture and Animation in Visual Effects. in O Sorkine, M Magnor, O Grau & C Theobalt (eds), Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality. CRC Press, pp. 311-321.
Cosker D. Facial Capture and Animation in Visual Effects. In Sorkine O, Magnor M, Grau O, Theobalt C, editors, Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality. CRC Press. 2015. p. 311-321.
Cosker, Darren. / Facial Capture and Animation in Visual Effects. Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality. editor / Olga Sorkine ; Marcus Magnor ; Oliver Grau ; Christian Theobalt. CRC Press, 2015. pp. 311-321
@inbook{5217f7c518be4a9caf64f0b88308b18b,
title = "Facial Capture and Animation in Visual Effects",
abstract = "In recent years, there has been increasing interest in facial animation re- search from both academia and the entertainment industry. Visual effects and video game companies both want to deliver new audience experiences – whether that is a hyper-realistic human character [Duncan 09] or a fantasy creature driven by a human performer [Duncan 10]. Having more efficient ways of delivering high quality animation, as well as increasing the visual realism of performances, has motivated a surge of innovative academic and industrial developments.Central to many of these developments are key technical advances in computer vision and graphics. Of particular note are advances in multi- view stereo reconstruction, facial tracking and motion capture, dense non- rigid registration of meshes, measurement of skin rendering attributes (e.g. BRDFs for skin and skin subsurface scattering models) and sensing tech- nology.This chapter builds on concepts already described earlier in this book – such as 3D capture, rigging, and non-rigid registration – and takes a more practical look at how they might typically be applied in visual effects. First, methods and applications for facial static capture and rendering are considered, before dynamic capture is addressed. Finally, a case study is examined called The Gathering involving the creation of an animated face – from animation to final composite.",
author = "Darren Cosker",
year = "2015",
month = "5",
day = "7",
language = "English",
isbn = "1482243814",
pages = "311--321",
editor = "Olga Sorkine and Marcus Magnor and Oliver Grau and Christian Theobalt",
booktitle = "Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality",
publisher = "CRC Press",
address = "USA United States",

}

TY - CHAP

T1 - Facial Capture and Animation in Visual Effects

AU - Cosker,Darren

PY - 2015/5/7

Y1 - 2015/5/7

N2 - In recent years, there has been increasing interest in facial animation re- search from both academia and the entertainment industry. Visual effects and video game companies both want to deliver new audience experiences – whether that is a hyper-realistic human character [Duncan 09] or a fantasy creature driven by a human performer [Duncan 10]. Having more efficient ways of delivering high quality animation, as well as increasing the visual realism of performances, has motivated a surge of innovative academic and industrial developments.Central to many of these developments are key technical advances in computer vision and graphics. Of particular note are advances in multi- view stereo reconstruction, facial tracking and motion capture, dense non- rigid registration of meshes, measurement of skin rendering attributes (e.g. BRDFs for skin and skin subsurface scattering models) and sensing tech- nology.This chapter builds on concepts already described earlier in this book – such as 3D capture, rigging, and non-rigid registration – and takes a more practical look at how they might typically be applied in visual effects. First, methods and applications for facial static capture and rendering are considered, before dynamic capture is addressed. Finally, a case study is examined called The Gathering involving the creation of an animated face – from animation to final composite.

AB - In recent years, there has been increasing interest in facial animation re- search from both academia and the entertainment industry. Visual effects and video game companies both want to deliver new audience experiences – whether that is a hyper-realistic human character [Duncan 09] or a fantasy creature driven by a human performer [Duncan 10]. Having more efficient ways of delivering high quality animation, as well as increasing the visual realism of performances, has motivated a surge of innovative academic and industrial developments.Central to many of these developments are key technical advances in computer vision and graphics. Of particular note are advances in multi- view stereo reconstruction, facial tracking and motion capture, dense non- rigid registration of meshes, measurement of skin rendering attributes (e.g. BRDFs for skin and skin subsurface scattering models) and sensing tech- nology.This chapter builds on concepts already described earlier in this book – such as 3D capture, rigging, and non-rigid registration – and takes a more practical look at how they might typically be applied in visual effects. First, methods and applications for facial static capture and rendering are considered, before dynamic capture is addressed. Finally, a case study is examined called The Gathering involving the creation of an animated face – from animation to final composite.

UR - https://www.crcpress.com/Digital-Representations-of-the-Real-World-How-to-Capture-Model-and-Render/Magnor-Grau-SorkineHornung-Theobalt/9781482243819

M3 - Chapter

SN - 1482243814

SP - 311

EP - 321

BT - Digital Representations of the Real World: How to Capture, Model, and Render Visual Reality

PB - CRC Press

ER -