Projects per year
Abstract
We propose a novel 360° scene representation for converting real scenes into stereoscopic 3D virtual reality content with head-motion parallax. Our image-based scene representation enables efficient synthesis of novel views with six degrees-of-freedom (6-DoF) by fusing motion fields at two scales: (1) disparity motion fields carry implicit depth information and are robustly estimated from multiple laterally displaced auxiliary viewpoints, and (2) pairwise motion fields enable real-time flow-based blending, which improves the visual fidelity of results by minimizing ghosting and view transition artifacts. Based on our scene representation, we present an end-to-end system that captures real scenes with a robotic camera arm, processes the recorded data, and finally renders the scene in a head-mounted display in real time (more than 40 Hz). Our approach is the first to support head-motion parallax when viewing real 360° scenes. We demonstrate compelling results that illustrate the enhanced visual experience – and hence sense of immersion – achieved with our approach compared to widely-used stereoscopic panoramas.
Original language | English |
---|---|
Pages (from-to) | 1545-1553 |
Number of pages | 9 |
Journal | IEEE Transactions on Visualization and Computer Graphics |
Volume | 24 |
Issue number | 4 |
DOIs | |
Publication status | Published - 17 Jan 2018 |
Event | IEEE Conference on Virtual Reality and 3D User Interfaces - Reutlingen, Germany Duration: 18 Mar 2018 → 22 Mar 2018 Conference number: 25 http://ieeevr.org/2018/ |
Keywords
- 360° scene capture
- 6 degrees-of-freedom (6-DoF)
- Head-motion parallax
- Image-based rendering
- Scene representation
ASJC Scopus subject areas
- Software
- Signal Processing
- Computer Vision and Pattern Recognition
- Computer Graphics and Computer-Aided Design
Fingerprint Dive into the research topics of 'Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax'. Together they form a unique fingerprint.
Projects
- 1 Active
-
Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)
Cosker, D., Campbell, N., Fincham Haines, T., Hall, P., Kim, K. I., Lutteroth, C., O'Neill, E., Richardt, C. & Yang, Y.
Engineering and Physical Sciences Research Council
1/09/15 → 28/02/21
Project: Research council