Patch based synthesis for single depth image super-resolution

Oisin Mac Aodha, Neill D. F. Campbell, Arun Nair, Gabriel J. Brostow

Research output: Chapter in Book/Report/Conference proceedingChapter

113 Citations (Scopus)

Abstract

We present an algorithm to synthetically increase the resolution of a solitary depth image using only a generic database of local patches. Modern range sensors measure depths with non-Gaussian noise and at lower starting resolutions than typical visible-light cameras. While patch based approaches for upsampling intensity images continue to improve, this is the first exploration of patching for depth images. We match against the height field of each low resolution input depth patch, and search our database for a list of appropriate high resolution candidate patches. Selecting the right candidate at each location in the depth image is then posed as a Markov random field labeling problem. Our experiments also show how important further depth-specific processing, such as noise removal and correct patch normalization, dramatically improves our results. Perhaps surprisingly, even better results are achieved on a variety of real test scenes by providing our algorithm with only synthetic training depth data.
Original languageEnglish
Title of host publicationComputer Vision – ECCV 2012
Subtitle of host publicationProceedings of 12th European Conference on Computer Vision, Part III
EditorsA. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, C. Schmid
Place of PublicationBerlin, Germany
PublisherSpringer
Pages71-84
Number of pages14
ISBN (Print)9783642337116
DOIs
Publication statusPublished - 2012
Event12th European Conference on Computer Vision,2012 - Florence, Italy
Duration: 7 Oct 201213 Oct 2012

Publication series

NameLecture Notes in Computer Science
Volume7574

Conference

Conference12th European Conference on Computer Vision,2012
CountryItaly
CityFlorence
Period7/10/1213/10/12

    Fingerprint

Cite this

Mac Aodha, O., Campbell, N. D. F., Nair, A., & Brostow, G. J. (2012). Patch based synthesis for single depth image super-resolution. In A. Fitzgibbon, S. Lazebnik, P. Perona, Y. Sato, & C. Schmid (Eds.), Computer Vision – ECCV 2012: Proceedings of 12th European Conference on Computer Vision, Part III (pp. 71-84). (Lecture Notes in Computer Science; Vol. 7574). Berlin, Germany: Springer. https://doi.org/10.1007/978-3-642-33712-3_6