Reconstructing mass-conserved water surfaces using shape from shading and optical flow

David Pickup, Chuan Li, Darren Cosker, Peter Hall, Philip Willis

Research output: Chapter in Book/Report/Conference proceedingChapter

  • 13 Citations

Abstract

This paper introduces a method for reconstructing water from real video footage. Using a single input video, the proposed method produces a more informative reconstruction from a wider range of possible scenes than the current state of the art. The key is the combination of vision algorithms and physics laws. Shape from shading is used to capture the change of the water's surface, from which a vertical velocity gradient field is calculated. Such a gradient field is used to constrain the tracking of horizontal velocities by minimizing an energy function as a weighted combination of mass-conservation and intensity-conservation. Hence the final reconstruction contains a dense velocity field that is incompressible in 3D. The proposed method is efficient and performs consistently well across water of different types.
LanguageEnglish
Title of host publicationComputer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers
Place of PublicationHeidelberg
PublisherSpringer
Pages189-201
Number of pages13
Volume6495 LNCS
ISBN (Print)0302-9743
DOIs
StatusPublished - 2011
Event10th Asian Conference on Computer Vision, ACCV 2010, November 8, 2010 - November 12, 2010 - Queenstown, New Zealand
Duration: 1 Jan 2011 → …

Conference

Conference10th Asian Conference on Computer Vision, ACCV 2010, November 8, 2010 - November 12, 2010
CountryNew Zealand
CityQueenstown
Period1/01/11 → …

Fingerprint

Optical flows
Conservation
Water
Physics

Cite this

Pickup, D., Li, C., Cosker, D., Hall, P., & Willis, P. (2011). Reconstructing mass-conserved water surfaces using shape from shading and optical flow. In Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers (Vol. 6495 LNCS, pp. 189-201). Heidelberg: Springer. DOI: 10.1007/978-3-642-19282-1_16

Reconstructing mass-conserved water surfaces using shape from shading and optical flow. / Pickup, David; Li, Chuan; Cosker, Darren; Hall, Peter; Willis, Philip.

Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. Vol. 6495 LNCS Heidelberg : Springer, 2011. p. 189-201.

Research output: Chapter in Book/Report/Conference proceedingChapter

Pickup, D, Li, C, Cosker, D, Hall, P & Willis, P 2011, Reconstructing mass-conserved water surfaces using shape from shading and optical flow. in Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. vol. 6495 LNCS, Springer, Heidelberg, pp. 189-201, 10th Asian Conference on Computer Vision, ACCV 2010, November 8, 2010 - November 12, 2010, Queenstown, New Zealand, 1/01/11. DOI: 10.1007/978-3-642-19282-1_16
Pickup D, Li C, Cosker D, Hall P, Willis P. Reconstructing mass-conserved water surfaces using shape from shading and optical flow. In Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. Vol. 6495 LNCS. Heidelberg: Springer. 2011. p. 189-201. Available from, DOI: 10.1007/978-3-642-19282-1_16
Pickup, David ; Li, Chuan ; Cosker, Darren ; Hall, Peter ; Willis, Philip. / Reconstructing mass-conserved water surfaces using shape from shading and optical flow. Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers. Vol. 6495 LNCS Heidelberg : Springer, 2011. pp. 189-201
@inbook{a908485d50ea4eac9b2547cb85a6b5c2,
title = "Reconstructing mass-conserved water surfaces using shape from shading and optical flow",
abstract = "This paper introduces a method for reconstructing water from real video footage. Using a single input video, the proposed method produces a more informative reconstruction from a wider range of possible scenes than the current state of the art. The key is the combination of vision algorithms and physics laws. Shape from shading is used to capture the change of the water's surface, from which a vertical velocity gradient field is calculated. Such a gradient field is used to constrain the tracking of horizontal velocities by minimizing an energy function as a weighted combination of mass-conservation and intensity-conservation. Hence the final reconstruction contains a dense velocity field that is incompressible in 3D. The proposed method is efficient and performs consistently well across water of different types.",
author = "David Pickup and Chuan Li and Darren Cosker and Peter Hall and Philip Willis",
note = "Lecture Notes in Computer Science Vol 6495. Conference article from 10th Asian Conference on Computer Vision, ACCV 2010. 8-12 November 2010. Queenstown, New zealand.",
year = "2011",
doi = "10.1007/978-3-642-19282-1_16",
language = "English",
isbn = "0302-9743",
volume = "6495 LNCS",
pages = "189--201",
booktitle = "Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers",
publisher = "Springer",

}

TY - CHAP

T1 - Reconstructing mass-conserved water surfaces using shape from shading and optical flow

AU - Pickup,David

AU - Li,Chuan

AU - Cosker,Darren

AU - Hall,Peter

AU - Willis,Philip

N1 - Lecture Notes in Computer Science Vol 6495. Conference article from 10th Asian Conference on Computer Vision, ACCV 2010. 8-12 November 2010. Queenstown, New zealand.

PY - 2011

Y1 - 2011

N2 - This paper introduces a method for reconstructing water from real video footage. Using a single input video, the proposed method produces a more informative reconstruction from a wider range of possible scenes than the current state of the art. The key is the combination of vision algorithms and physics laws. Shape from shading is used to capture the change of the water's surface, from which a vertical velocity gradient field is calculated. Such a gradient field is used to constrain the tracking of horizontal velocities by minimizing an energy function as a weighted combination of mass-conservation and intensity-conservation. Hence the final reconstruction contains a dense velocity field that is incompressible in 3D. The proposed method is efficient and performs consistently well across water of different types.

AB - This paper introduces a method for reconstructing water from real video footage. Using a single input video, the proposed method produces a more informative reconstruction from a wider range of possible scenes than the current state of the art. The key is the combination of vision algorithms and physics laws. Shape from shading is used to capture the change of the water's surface, from which a vertical velocity gradient field is calculated. Such a gradient field is used to constrain the tracking of horizontal velocities by minimizing an energy function as a weighted combination of mass-conservation and intensity-conservation. Hence the final reconstruction contains a dense velocity field that is incompressible in 3D. The proposed method is efficient and performs consistently well across water of different types.

UR - http://dx.doi.org/10.1007/978-3-642-19282-1_16

U2 - 10.1007/978-3-642-19282-1_16

DO - 10.1007/978-3-642-19282-1_16

M3 - Chapter

SN - 0302-9743

VL - 6495 LNCS

SP - 189

EP - 201

BT - Computer Vision, ACCV 2010 - 10th Asian Conference on Computer Vision, Revised Selected Papers

PB - Springer

CY - Heidelberg

ER -