Projects per year
We present a novel approach for real-time joint reconstruction of 3D scene motion and geometry from binocular stereo videos. Our approach is based on a novel variational halfway-domain scene flow formulation, which allows us to obtain highly accurate spatiotemporal reconstructions of shape and motion. We solve the underlying optimization problem at real-time frame rates using a novel data-parallel robust non-linear optimization strategy. Fast convergence and large displacement flows are achieved by employing a novel hierarchy that stores delta flows between hierarchy levels. High performance is obtained by the introduction of a coarser warp grid that decouples the number of unknowns from the input resolution of the images. We demonstrate our approach in a live setup that is based on two commodity webcams, as well as on publicly available video data. Our extensive experiments and evaluations show that our approach produces high-quality dense reconstructions of 3D geometry and scene flow at real-time frame rates, and compares favorably to the state of the art.
|Number of pages||10|
|Publication status||Published - 25 Oct 2016|
|Event||International Conference on 3D Vision - Stanford University, Palo Alto, USA United States|
Duration: 25 Oct 2016 → 28 Oct 2016
|Conference||International Conference on 3D Vision|
|Country/Territory||USA United States|
|Period||25/10/16 → 28/10/16|
FingerprintDive into the research topics of 'Real-time Halfway Domain Reconstruction of Motion and Geometry'. Together they form a unique fingerprint.
- 1 Finished
Centre for the Analysis of Motion, Entertainment Research and Applications (CAMERA)
Cosker, D., Bilzon, J., Campbell, N., Cazzola, D., Colyer, S., Fincham Haines, T., Hall, P., Kim, K. I., Lutteroth, C., McGuigan, P., O'Neill, E., Richardt, C., Salo, A., Seminati, E., Tabor, A. & Yang, Y.
Engineering and Physical Sciences Research Council
1/09/15 → 28/02/21
Project: Research council