Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax

Bicheng Luo, Feng Xu, Christian Richardt, Jun-Hai Yong

Research output: Contribution to journalArticle

16 Citations (Scopus)
202 Downloads (Pure)

Abstract

We propose a novel 360° scene representation for converting real scenes into stereoscopic 3D virtual reality content with head-motion parallax. Our image-based scene representation enables efficient synthesis of novel views with six degrees-of-freedom (6-DoF) by fusing motion fields at two scales: (1) disparity motion fields carry implicit depth information and are robustly estimated from multiple laterally displaced auxiliary viewpoints, and (2) pairwise motion fields enable real-time flow-based blending, which improves the visual fidelity of results by minimizing ghosting and view transition artifacts. Based on our scene representation, we present an end-to-end system that captures real scenes with a robotic camera arm, processes the recorded data, and finally renders the scene in a head-mounted display in real time (more than 40 Hz). Our approach is the first to support head-motion parallax when viewing real 360° scenes. We demonstrate compelling results that illustrate the enhanced visual experience – and hence sense of immersion – achieved with our approach compared to widely-used stereoscopic panoramas.
Original languageEnglish
Pages (from-to)1545-1553
Number of pages9
JournalIEEE Transactions on Visualization and Computer Graphics
Volume24
Issue number4
DOIs
Publication statusPublished - 17 Jan 2018
EventIEEE Conference on Virtual Reality and 3D User Interfaces - Reutlingen, Germany
Duration: 18 Mar 201822 Mar 2018
Conference number: 25
http://ieeevr.org/2018/

Keywords

  • 360° scene capture
  • 6 degrees-of-freedom (6-DoF)
  • Head-motion parallax
  • Image-based rendering
  • Scene representation

ASJC Scopus subject areas

  • Software
  • Signal Processing
  • Computer Vision and Pattern Recognition
  • Computer Graphics and Computer-Aided Design

Fingerprint Dive into the research topics of 'Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax'. Together they form a unique fingerprint.

  • Projects

    Cite this