Interactive sketch-driven image synthesis

Daniyar Turmukhambetov, Neill D. F. Campbell, Dan B. Goldman, Jan Kautz

Research output: Contribution to journalArticle

6 Citations (Scopus)
79 Downloads (Pure)

Abstract

We present an interactive system for composing realistic images of an object under arbitrary pose and appearance specified by sketching. Our system draws inspiration from a traditional illustration workflow: The user first sketches rough ‘masses’ of the object, as ellipses, to define an initial abstract pose that can then be refined with more detailed contours as desired. The system is made robust to partial or inaccurate sketches using a reduced-dimensionality model of pose space learnt from a labelled collection of photos. Throughout the composition process, interactive visual feedback is provided to guide the user. Finally, the user's partial or complete sketch, complemented with appearance requirements, is used to constrain the automatic synthesis of a novel, high-quality, realistic image.
Original languageEnglish
Pages (from-to)130-142
Number of pages13
JournalComputer Graphics Forum
Volume34
Issue number8
Early online date13 Aug 2015
DOIs
Publication statusPublished - Dec 2015

Fingerprint

Image quality
Feedback
Chemical analysis

Cite this

Interactive sketch-driven image synthesis. / Turmukhambetov, Daniyar; Campbell, Neill D. F.; Goldman, Dan B.; Kautz, Jan.

In: Computer Graphics Forum, Vol. 34, No. 8, 12.2015, p. 130-142.

Research output: Contribution to journalArticle

Turmukhambetov, D, Campbell, NDF, Goldman, DB & Kautz, J 2015, 'Interactive sketch-driven image synthesis', Computer Graphics Forum, vol. 34, no. 8, pp. 130-142. https://doi.org/10.1111/cgf.12665
Turmukhambetov, Daniyar ; Campbell, Neill D. F. ; Goldman, Dan B. ; Kautz, Jan. / Interactive sketch-driven image synthesis. In: Computer Graphics Forum. 2015 ; Vol. 34, No. 8. pp. 130-142.
@article{bfda952df7b14d899781b280ea725284,
title = "Interactive sketch-driven image synthesis",
abstract = "We present an interactive system for composing realistic images of an object under arbitrary pose and appearance specified by sketching. Our system draws inspiration from a traditional illustration workflow: The user first sketches rough ‘masses’ of the object, as ellipses, to define an initial abstract pose that can then be refined with more detailed contours as desired. The system is made robust to partial or inaccurate sketches using a reduced-dimensionality model of pose space learnt from a labelled collection of photos. Throughout the composition process, interactive visual feedback is provided to guide the user. Finally, the user's partial or complete sketch, complemented with appearance requirements, is used to constrain the automatic synthesis of a novel, high-quality, realistic image.",
author = "Daniyar Turmukhambetov and Campbell, {Neill D. F.} and Goldman, {Dan B.} and Jan Kautz",
year = "2015",
month = "12",
doi = "10.1111/cgf.12665",
language = "English",
volume = "34",
pages = "130--142",
journal = "Computer Graphics Forum",
issn = "0167-7055",
publisher = "Wiley-Blackwell",
number = "8",

}

TY - JOUR

T1 - Interactive sketch-driven image synthesis

AU - Turmukhambetov, Daniyar

AU - Campbell, Neill D. F.

AU - Goldman, Dan B.

AU - Kautz, Jan

PY - 2015/12

Y1 - 2015/12

N2 - We present an interactive system for composing realistic images of an object under arbitrary pose and appearance specified by sketching. Our system draws inspiration from a traditional illustration workflow: The user first sketches rough ‘masses’ of the object, as ellipses, to define an initial abstract pose that can then be refined with more detailed contours as desired. The system is made robust to partial or inaccurate sketches using a reduced-dimensionality model of pose space learnt from a labelled collection of photos. Throughout the composition process, interactive visual feedback is provided to guide the user. Finally, the user's partial or complete sketch, complemented with appearance requirements, is used to constrain the automatic synthesis of a novel, high-quality, realistic image.

AB - We present an interactive system for composing realistic images of an object under arbitrary pose and appearance specified by sketching. Our system draws inspiration from a traditional illustration workflow: The user first sketches rough ‘masses’ of the object, as ellipses, to define an initial abstract pose that can then be refined with more detailed contours as desired. The system is made robust to partial or inaccurate sketches using a reduced-dimensionality model of pose space learnt from a labelled collection of photos. Throughout the composition process, interactive visual feedback is provided to guide the user. Finally, the user's partial or complete sketch, complemented with appearance requirements, is used to constrain the automatic synthesis of a novel, high-quality, realistic image.

UR - http://dx.doi.org/10.1111/cgf.12665

U2 - 10.1111/cgf.12665

DO - 10.1111/cgf.12665

M3 - Article

VL - 34

SP - 130

EP - 142

JO - Computer Graphics Forum

JF - Computer Graphics Forum

SN - 0167-7055

IS - 8

ER -