MegaParallax: 360° Panoramas with Motion Parallax

We propose a pipeline to capture, process and display cylindrical 360° panoramas with motion parallax, an important depth cue for monocular vision, suitable for real-world VR applications. We do not stitch a video into an equirectangular representation, but use the individual frames in an omnidirectional stereo panorama setup [3] and perform image-based rendering (IBR) without accurate scene proxy or per-image depth maps. The IBR formulation allows our method to synthesise novel viewpoints on-the-fly within the area of the captured camera circle, sampling input images efficiently per pixel in order to create a novel view, which in turn leads to motion parallax. Our approach makes it possible for casual consumers to capture and view high-quality 360° panoramas with binocular disparity and motion parallax. We assume static environments throughout the pipeline.


This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992