Projects per year
Abstract
In this paper, a Supervised Classification assisted Markov Random Field (SC-MRF) model is proposed for generating high-quality up-sampled depth maps. The proposed model aims to reduce depth bleeding and depth confusion artifacts that can be produced at boundary regions of the up-sampled depth maps. In the proposed model, segmentation of low-resolution (LR) depth map is first used to supervise the classification of corresponding high-resolution (HR) color image. With this supervised classification, not only can the depth edges be retained, but redundant textures in the HR color image can be omitted. The classification result is then introduced into the design of a MRF energy function, and the final up-sampled depth map is obtained by optimizing this energy function with the gradient descent algorithm. For simplicity, classical K-means clustering is adopted to segment the LR depth map into several classes, and a feature-based K-nearest neighbour (K-NN) method is utilized for the supervised classification. With the proposed SC-MRF model, interaction between depths of different classes will be strongly suppressed, meaning depth edges are well preserved. Comparisons with the state-of-the-art demonstrate the strong performance of the proposed method both visually and by quantitative evaluation.
Original language | English |
---|---|
Pages (from-to) | 315-320 |
Number of pages | 6 |
Journal | Pattern Recognition Letters |
Volume | 138 |
Early online date | 24 Jul 2020 |
DOIs | |
Publication status | Published - 31 Oct 2020 |
Funding
The authors would like to thank Middlebury, for distributing their data sets. This work was additionally supported by the Major Research Plan of National Natural Science Foundation of China number 91438201 , the National Natural Science Foundation of China number 61573267 , the Innovate UK grant number 104541 and the EPSRC grant number EP/M023281/1 .
Keywords
- Gradient descent algorithm
- K-means clustering
- K-NN
- Markov random fields
- Supervised classification
ASJC Scopus subject areas
- Software
- Signal Processing
- Computer Vision and Pattern Recognition
- Artificial Intelligence
Fingerprint
Dive into the research topics of 'High-quality depth up-sampling via a supervised classification guided MRF model'. Together they form a unique fingerprint.-
Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA) - 2.0
Campbell, N. (PI), Cosker, D. (PI), Bilzon, J. (CoI), Campbell, N. (CoI), Cazzola, D. (CoI), Colyer, S. (CoI), Cosker, D. (CoI), Lutteroth, C. (CoI), McGuigan, P. (CoI), O'Neill, E. (CoI), Petrini, K. (CoI), Proulx, M. (CoI) & Yang, Y. (CoI)
Engineering and Physical Sciences Research Council
1/11/20 → 31/10/25
Project: Research council
-
Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)
Cosker, D. (PI), Bilzon, J. (CoI), Campbell, N. (CoI), Cazzola, D. (CoI), Colyer, S. (CoI), Fincham Haines, T. (CoI), Hall, P. (CoI), Kim, K. I. (CoI), Lutteroth, C. (CoI), McGuigan, P. (CoI), O'Neill, E. (CoI), Richardt, C. (CoI), Salo, A. (CoI), Seminati, E. (CoI), Tabor, A. (CoI) & Yang, Y. (CoI)
Engineering and Physical Sciences Research Council
1/09/15 → 28/02/21
Project: Research council