OmniPhotos: Casual 360° VR Photography with Motion Parallax

Tobias Bertel, Mingze Yuan, Reuben Lindroos, Christian Richardt

Research output: Chapter in Book/Report/Conference proceedingConference contribution

49 Downloads (Pure)

Abstract

Until now, immersive 360° VR panoramas could not be captured casually and reliably at the same time as state-of-the-art approaches involve time-consuming or expensive capture processes that prevent the casual capture of real-world VR environments. Existing approaches are also often limited in their supported range of head motion. We introduce OmniPhotos, a novel approach for casually and reliably capturing high-quality 360° VR panoramas. Our approach only requires a single sweep of a consumer 360° video camera as input, which takes less than 3 seconds with a rotating selfie stick. The captured video is transformed into a hybrid scene representation consisting of a coarse scene-specific proxy geometry and optical flow between consecutive video frames, enabling 5-DoF real-world VR experiences. The large capture radius and 360° field of view significantly expand the range of head motion compared to previous approaches. Among all competing methods, ours is the simplest, and fastest by an order of magnitude. We have captured more than 50 OmniPhotos and show video results for a large variety of scenes. We will make our code and datasets publicly available.


This project has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 665992 


Original languageEnglish
Title of host publicationSIGGRAPH Asia 2020 Emerging Technologies
PublisherAssociation for Computing Machinery
Number of pages2
ISBN (Electronic)9781450381109
DOIs
Publication statusPublished - 4 Dec 2020
EventACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia - Online, Online, Korea, Republic of
Duration: 4 Dec 202013 Dec 2020
Conference number: 13
https://sa2020.siggraph.org/en/

Publication series

NameSIGGRAPH Asia Emerging Technologies

Conference

ConferenceACM SIGGRAPH Conference and Exhibition on Computer Graphics and Interactive Techniques in Asia
Abbreviated titleSIGGRAPH Asia
Country/TerritoryKorea, Republic of
CityOnline
Period4/12/2013/12/20
Internet address

Fingerprint

Dive into the research topics of 'OmniPhotos: Casual 360° VR Photography with Motion Parallax'. Together they form a unique fingerprint.

Cite this