How not to be seen: object removal from videos of crowded scenes

Miguel Granados, James Tompkin, Kwang In Kim, Oliver Grau, Jan Kautz, Christian Theobalt

Research output: Contribution to journalArticlepeer-review

74 Citations (SciVal)

Abstract

Removing dynamic objects from videos is an extremely challenging problem that even visual effects professionals often solve with time-consuming manual frame-by-frame editing. We propose a new approach to video completion that can deal with complex scenes containing dynamic background and non-periodical moving objects. We build upon the idea that the spatio-temporal hole left by a removed object can be filled with data available on other regions of the video where the occluded objects were visible. Video completion is performed by solving a large combinatorial problem that searches for an optimal pattern of pixel offsets from occluded to unoccluded regions. Our contribution includes an energy functional that generalizes well over different scenes with stable parameters, and that has the desirable convergence properties for a graph-cut-based optimization. We provide an interface to guide the completion process that both reduces computation time and allows for efficient correction of small errors in the result. We demonstrate that our approach can effectively complete complex, high-resolution occlusions that are greater in difficulty than what existing methods have shown.
Original languageEnglish
Pages (from-to)219-228
Number of pages10
JournalComputer Graphics Forum
Volume31
Issue number2 Part 1
DOIs
Publication statusPublished - May 2012

Fingerprint

Dive into the research topics of 'How not to be seen: object removal from videos of crowded scenes'. Together they form a unique fingerprint.

Cite this