A sparse optimization approach to infinite infimal convolution regularization

Kristian Bredies, Marcello Carioni, Martin Holler, Yury Korolev, Carola-Bibiane Schönlieb

Research output: Contribution to journalArticlepeer-review

31 Downloads (Pure)

Abstract

In this paper we introduce the class of infinite infimal convolution functionals and apply these functionals to the regularization of ill-posed inverse problems. The proposed regularization involves an infimal convolution of a continuously parametrized family of convex, positively one-homogeneous functionals defined on a common Banach space $X$. We show that, under mild assumptions, this functional admits an equivalent convex lifting in the space of measures with values in $X$. This reformulation allows us to prove well-posedness of a Tikhonov regularized inverse problem and opens the door to a sparse analysis of the solutions. In the case of finite-dimensional measurements we prove a representer theorem, showing that there exists a solution of the inverse problem that is sparse, in the sense that it can be represented as a linear combination of the extremal points of the ball of the lifted infinite infimal convolution functional. Then, we design a generalized conditional gradient method for computing solutions of the inverse problem without relying on an a priori discretization of the parameter space and of the Banach space $X$. The iterates are constructed as linear combinations of the extremal points of the lifted infinite infimal convolution functional. We prove a sublinear rate of convergence for our algorithm and apply it to denoising of signals and images using, as regularizer, infinite infimal convolutions of fractional-Laplacian-type operators with adaptive orders of smoothness and anisotropies.
Original languageEnglish
Pages (from-to)41-96
Number of pages56
JournalNumerische Mathematik
Volume157
Issue number1
Early online date21 Nov 2024
DOIs
Publication statusPublished - 28 Feb 2025

Funding

KB gratefully acknowledges support by the Austrian Science Fund (FWF) through project P 29192 \u201CRegularization graphs for variational imaging\u201D. MC is supported by the Royal Society (Newton International Fellowship NIFR1192048 \u201CMinimal partitions as a robustness boost for neural network classifiers\u201D). The Department of Mathematics and Scientific Computing, to which KB and MH are affiliated, is a member of NAWI Graz ( https://www.nawigraz.at/en/ ). KB and MH are further members of BioTechMed Graz ( https://biotechmedgraz.at/en/ ). YK acknowledges support of the EPSRC (Fellowship EP/V003615/2 and Programme Grant EP/V026259/1) and the National Physical Laboratory. CBS acknowledges support from the Philip Leverhulme Prize, the Royal Society Wolfson Fellowship, the EPSRC advanced career fellowship EP/V029428/1, EPSRC grants EP/S026045/1 and EP/T003553/1, EP/N014588/1, EP/T017961/1, the Wellcome Innovator Awards 215733/Z/19/Z and 221633/Z/20/Z, the European Union Horizon 2020 research and innovation programme under the Marie Skodowska-Curie grant agreement No. 777826 NoMADS, the Cantab Capital Institute for the Mathematics of Information, and the Alan Turing Institute. MC, YK, and CBS would like to thank the Isaac Newton Institute for Mathematical Sciences in Cambridge (supported by EPSRC grant no EP/R014604/1) for support and hospitality during the programme \u201CMathematics of Deep Learning\u201D where part of the work on this paper was undertaken.

FundersFunder number
Marie Skodowska-Curie777826
Austrian Science FundP 29192
The Wellcome Trust215733/Z/19/Z, 221633/Z/20/Z
Royal SocietyNIFR1192048
Alan Turing InstituteEP/R014604/1
National Physics LaboratoryEP/N014588/1, EP/S026045/1, EP/T017961/1, EP/T003553/1, EP/V029428/1
Engineering and Physical Sciences Research CouncilEP/V003615/2, EP/V026259/1

Keywords

  • 35R11
  • 49J45
  • 65J20
  • 65K10

ASJC Scopus subject areas

  • Computational Mathematics
  • Applied Mathematics

Fingerprint

Dive into the research topics of 'A sparse optimization approach to infinite infimal convolution regularization'. Together they form a unique fingerprint.

Cite this