Image-Based Scene Representations for Head-Motion Parallax in 360° Panoramas

Tobias Bertel, Feng Xu, Christian Richardt

Research output: Chapter or section in a book/report/conference proceedingChapter or section

1 Citation (SciVal)
93 Downloads (Pure)


Creation and delivery of “RealVR” experiences essentially consists of the following four main steps: capture, processing, representation and rendering. In this chapter, we present, compare, and discuss two recent end-to-end approaches, Parallax360 by Luo et al. [9] and MegaParallax by Bertel et al. [3]. Both propose complete pipelines for RealVR content generation and novel-view synthesis with head-motion parallax for 360° environments.

Parallax360 uses a robotic arm for capturing thousands of input views on the surface of a sphere. Based on precomputed disparity motion fields and pairwise optical flow, novel viewpoints are synthesized on the fly using flow-based blending of the nearest two to three input views which provides compelling head-motion parallax.

MegaParallax proposes a pipeline for RealVR content generation and rendering that emphasizes casual, hand-held capturing. The approach introduces view-dependent flow-based blending to enable novel-view synthesis with head-motion parallax within a viewing area determined by the field of view of the input cameras and the capturing radius.

We describe both methods and discuss their similarities and differences in corresponding steps in the RealVR pipeline and show selected results. The chapter ends by discussing advantages and disadvantages as well as outlining the most important limitations and future work.

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992
Original languageEnglish
Title of host publicationReal VR – Immersive Digital Reality
Subtitle of host publicationHow to Import the Real World into Head-Mounted Immersive Displays
EditorsMarcus Magnor, Alexander Sorkine-Horning
PublisherSpringer International Publishing
Number of pages23
ISBN (Electronic)978-3-030-41816-8
ISBN (Print)978-3-030-41815-1
Publication statusPublished - 3 Mar 2020

Publication series

NameLecture Notes in Computer Science


Dive into the research topics of 'Image-Based Scene Representations for Head-Motion Parallax in 360° Panoramas'. Together they form a unique fingerprint.

Cite this