Abstract
Pixel art is a unique art style with the appearance of low resolution images. In this paper, we propose a data-drivenpixelization method that can produce sharp and crisp cell effects with controllable cell sizes. Our approach overcomes the limitation of existing learning-based methods in cell size control by introducing a reference pixel art to explicitly regularize the cell structure. In particular, the cell structure features of the reference pixel art are used as an auxiliary input for the pixelization process, and for measuring the style similarity between the generated result and the reference pixel art. Furthermore, we disentangle the pixelization process into specific cell-aware and aliasing-aware stages, mitigating the ambiguities in joint learning of cell size, aliasing effect, and color assignment. To train our model, we construct a dedicated pixel art dataset and augment it with different cell sizes and different degrees of anti-aliasing effects. Extensive experiments demonstrate its superior performance over state-of-the-arts in terms of cell sharpness and perceptual expressiveness. We also show promising results of video game pixelization for the first time. Code and dataset are available at https://github.com/WuZongWei6/Pixelization.
Original language | English |
---|---|
Article number | 193 |
Journal | ACM Transactions on Graphics |
Volume | 41 |
Issue number | 6 |
Early online date | 30 Nov 2022 |
DOIs | |
Publication status | Published - 31 Dec 2022 |
Bibliographical note
Publisher Copyright:© 2022 ACM.
Keywords
- generative adversarial networks
- image-to-image translation
- pixelization
ASJC Scopus subject areas
- Computer Graphics and Computer-Aided Design