The computational complexity of naive, sampling-based uncertainty quantification for 3D partial differential equations is extremely high. Multilevel approaches, such as multilevel Monte Carlo (MLMC), can reduce the complexity significantly when they are combined with a fast multigrid solver, but to exploit them fully in a parallel environment, sophisticated scheduling strategies are needed. We optimize the concurrent execution across the three layers of the MLMC method: parallelization across levels, across samples, and across the spatial grid. In a series of numerical tests, the influence on the overall performance of the “scalability window” of the multigrid solver (i.e., the range of processor numbers over which good parallel efficiency can be maintained) is illustrated. Different homogeneous and heterogeneous scheduling strategies are proposed and discussed. Finally, large 3D scaling experiments are carried out, including adaptivity.
Drzisga, D., Gmeiner, B., Rüde, U., Scheichl, R., & Wohlmuth, B. (2017). Scheduling Massively Parallel Multigrid for Multilevel Monte Carlo Methods. SIAM Journal on Scientific Computing, 39(5), S873-S897. https://doi.org/10.1137/16M1083591