Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography

Tobias Bertel; Moritz Mühlhausen; Moritz Kappel; Paul M. Bittner; Christian Richardt; Marcus Magnor

doi:10.1109/VRW50115.2020.00181

Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography

Tobias Bertel, Moritz Mühlhausen, Moritz Kappel, Paul M. Bittner, Christian Richardt, Marcus Magnor

Technische Universitat Braunschweig

Research output: Contribution to conference › Poster › peer-review

4 Citations (SciVal)

128 Downloads (Pure)

Abstract

We present an end-to-end pipeline that enables head-motion parallax for omnidirectional stereo (ODS) panoramas. Based on an ODS panorama containing a left and right eye view, our method estimates dense horizontal disparity fields between the stereo image pair. From this, we calculate a depth augmented stereo panorama (DASP) by explicitly reconstructing the scene geometry from the viewing circle corresponding to the ODS representation. The generated DASP representation supports motion parallax within the ODS viewing circle. Our approach operates directly on existing ODS panoramas. The experiments indicate the robustness and versatility of our approach on multiple real-world ODS panoramas.

This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

Original language	English
Number of pages	2
DOIs	https://doi.org/10.1109/VRW50115.2020.00181
Publication status	Published - 22 Mar 2020
Event	2020 IEEE Conference on Virtual Reality and 3D User Interfaces - online, Atlanta, USA United States Duration: 22 Mar 2020 → 26 Mar 2020 http://ieeevr.org/2020/

Conference

Conference	2020 IEEE Conference on Virtual Reality and 3D User Interfaces
Abbreviated title	IEEE VR
Country/Territory	USA United States
City	Atlanta
Period	22/03/20 → 26/03/20
Internet address	http://ieeevr.org/2020/

Access to Document

10.1109/VRW50115.2020.00181

ODS2DASP-BertelMühlhausenEtAl-IEEEVRPoster2020Accepted author manuscript, 702 KB

Fellowship - Towards Immersive 360° VR Video with Motion Parallax
Richardt, C. (PI)
Engineering and Physical Sciences Research Council
25/06/18 → 24/12/21
Project: Research council
Fellow for Industrial Research Enhancement (FIRE)
Scott, J. L. (PI) & Yang, Y. (CoI)
EU - Horizon 2020
1/10/15 → 30/03/21
Project: EU Commission
Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)
Cosker, D. (PI), Bilzon, J. (CoI), Campbell, N. (CoI), Cazzola, D. (CoI), Colyer, S. (CoI), Fincham Haines, T. (CoI), Hall, P. (CoI), Kim, K. I. (CoI), Lutteroth, C. (CoI), McGuigan, P. (CoI), O'Neill, E. (CoI), Richardt, C. (CoI), Salo, A. (CoI), Seminati, E. (CoI), Tabor, A. (CoI) & Yang, Y. (CoI)
Engineering and Physical Sciences Research Council
1/09/15 → 28/02/21
Project: Research council

Cite this

@conference{16fb0d1b8cdc4a89a94648f41d220e2f,

title = "Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography",

abstract = "We present an end-to-end pipeline that enables head-motion parallax for omnidirectional stereo (ODS) panoramas. Based on an ODS panorama containing a left and right eye view, our method estimates dense horizontal disparity fields between the stereo image pair. From this, we calculate a depth augmented stereo panorama (DASP) by explicitly reconstructing the scene geometry from the viewing circle corresponding to the ODS representation. The generated DASP representation supports motion parallax within the ODS viewing circle. Our approach operates directly on existing ODS panoramas. The experiments indicate the robustness and versatility of our approach on multiple real-world ODS panoramas.This project has received funding from the European Union{\textquoteright}s Horizon 2020 research and innovation programme under the Marie Sk{\l}odowska-Curie grant agreement No 665992 ",

author = "Tobias Bertel and Moritz M{\"u}hlhausen and Moritz Kappel and Bittner, {Paul M.} and Christian Richardt and Marcus Magnor",

year = "2020",

month = mar,

day = "22",

doi = "10.1109/VRW50115.2020.00181",

language = "English",

note = "2020 IEEE Conference on Virtual Reality and 3D User Interfaces, IEEE VR ; Conference date: 22-03-2020 Through 26-03-2020",

url = "http://ieeevr.org/2020/",

}

TY - CONF

T1 - Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography

AU - Bertel, Tobias

AU - Mühlhausen, Moritz

AU - Kappel, Moritz

AU - Bittner, Paul M.

AU - Richardt, Christian

AU - Magnor, Marcus

PY - 2020/3/22

Y1 - 2020/3/22

N2 - We present an end-to-end pipeline that enables head-motion parallax for omnidirectional stereo (ODS) panoramas. Based on an ODS panorama containing a left and right eye view, our method estimates dense horizontal disparity fields between the stereo image pair. From this, we calculate a depth augmented stereo panorama (DASP) by explicitly reconstructing the scene geometry from the viewing circle corresponding to the ODS representation. The generated DASP representation supports motion parallax within the ODS viewing circle. Our approach operates directly on existing ODS panoramas. The experiments indicate the robustness and versatility of our approach on multiple real-world ODS panoramas.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

AB - We present an end-to-end pipeline that enables head-motion parallax for omnidirectional stereo (ODS) panoramas. Based on an ODS panorama containing a left and right eye view, our method estimates dense horizontal disparity fields between the stereo image pair. From this, we calculate a depth augmented stereo panorama (DASP) by explicitly reconstructing the scene geometry from the viewing circle corresponding to the ODS representation. The generated DASP representation supports motion parallax within the ODS viewing circle. Our approach operates directly on existing ODS panoramas. The experiments indicate the robustness and versatility of our approach on multiple real-world ODS panoramas.This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992

U2 - 10.1109/VRW50115.2020.00181

DO - 10.1109/VRW50115.2020.00181

M3 - Poster

T2 - 2020 IEEE Conference on Virtual Reality and 3D User Interfaces

Y2 - 22 March 2020 through 26 March 2020

ER -

Depth Augmented Omnidirectional Stereo for 6-DoF VR Photography

Abstract

Conference

Access to Document

Fingerprint

Projects

Fellowship - Towards Immersive 360° VR Video with Motion Parallax

Fellow for Industrial Research Enhancement (FIRE)

Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)

Cite this