Roto++: accelerating professional rotoscoping using shape manifolds

Wenbin Li, Fabio Viola, Jonathan Starck, Gabriel J. Brostow, Neill Campbell

Research output: Contribution to journalArticle

18 Citations (Scopus)
124 Downloads (Pure)

Abstract

Rotoscoping (cutting out different characters/objects/layers in raw video footage) is a ubiquitous task in modern post-production and represents a significant investment in person-hours. In this work, we study the particular task of professional rotoscoping for high-end, live action movies and propose a new framework that works with roto-artists to accelerate the workflow and improve their productivity. Working with the existing keyframing paradigm, our first contribution is the development of a shape model that is updated as artists add successive keyframes. This model is used to improve the output of traditional interpolation and tracking techniques, reducing the number of keyframes that need to be specified by the artist. Our second contribution is to use the same shape model to provide a new interactive tool that allows an artist to reduce the time spent editing each keyframe. The more keyframes that are edited, the better the interactive tool becomes, accelerating the process and making the artist more efficient without compromising their control. Finally, we also provide a new, professionally rotoscoped dataset that enables truly representative, real-world evaluation of rotoscoping methods. We used this dataset to perform a number of experiments, including an expert study with professional roto-artists, to show, quantitatively, the advantages of our approach.
Original languageEnglish
Article number62
Number of pages15
JournalACM Transactions on Graphics
Volume35
Issue number4
Early online date11 Jul 2016
DOIs
Publication statusPublished - 31 Jul 2016

    Fingerprint

Cite this