Projects per year
Abstract
Characterising intractable high-dimensional random variables is one of the fundamental challenges in stochastic computation. The recent surge of transport maps offers a mathematical foundation and new insights for tackling this challenge by coupling intractable random variables with tractable reference random variables. This paper generalises the functional tensor-train approximation of the inverse Rosenblatt transport recently developed by Dolgov et al. (Stat Comput 30:603–625, 2020) to a wide class of high-dimensional non-negative functions, such as unnormalised probability density functions. First, we extend the inverse Rosenblatt transform to enable the transport to general reference measures other than the uniform measure. We develop an efficient procedure to compute this transport from a squared tensor-train decomposition which preserves the monotonicity. More crucially, we integrate the proposed order-preserving functional tensor-train transport into a nested variable transformation framework inspired by the layered structure of deep neural networks. The resulting deep inverse Rosenblatt transport significantly expands the capability of tensor approximations and transport maps to random variables with complicated nonlinear interactions and concentrated density functions. We demonstrate the efficiency of the proposed approach on a range of applications in statistical learning and uncertainty quantification, including parameter estimation for dynamical systems and inverse problems constrained by partial differential equations.
Original language | English |
---|---|
Number of pages | 47 |
Journal | Foundations of Computational Mathematics |
DOIs | |
Publication status | Published - 21 Sept 2021 |
Bibliographical note
Funding Information:The author would like to thank Y. Marzouk and R. Scheichl for many insightful discussions. T. Cui acknowledges support from the Australian Research Council, under grant number CE140100049. S. Dolgov acknowledges support from the International Visitor Program of Sydney Mathematical Research Institute, and from the EPSRC New Investigator Award EP/T031255/1.
Publisher Copyright:
© 2021, The Author(s).
Keywords
- Deep transport maps
- Inverse problems
- Rosenblatt transport
- Tensor-train
- Uncertainty quantification
ASJC Scopus subject areas
- Analysis
- Computational Mathematics
- Computational Theory and Mathematics
- Applied Mathematics
Fingerprint
Dive into the research topics of 'Deep Composition of Tensor Trains using Squared Inverse Rosenblatt Transports'. Together they form a unique fingerprint.-
Tensor decomposition sampling algorithms for Bayesian inverse problems
Dolgov, S. (PI)
Engineering and Physical Sciences Research Council
1/03/21 → 28/02/25
Project: Research council
-
Tensor product numerical methods for high-dimensional problems in probability and quantum calculations
Dolgov, S. (PI)
1/01/16 → 31/12/18
Project: Research council