Recent research in inverse problems seeks to develop a mathematically coherent foundation for combining data-driven models, and in particular those based on deep learning, with domain-specific knowledge contained in physical–analytical models. The focus is on solving ill-posed inverse problems that are at the core of many challenging applications in the natural sciences, medicine and life sciences, as well as in engineering and industrial applications. This survey paper aims to give an account of some of the main contributions in data-driven inverse problems.

No abstract

We propose a stochastic extension of the primal-dual hybrid gradient algorithm studied by Chambolle and Pock in 2011 to solve saddle point problems that are separable in the dual variable. The analysis is carried out for general convex-concave saddle point problems and problems that are either partially smooth / strongly convex or fully smooth / strongly convex. We perform the analysis for arbitrary samplings of dual variables, and obtain known deterministic results as a special case. Several variants of our stochastic method significantly outperform the deterministic variant on a variety of imaging tasks.

We propose a PDE-constrained optimization approach for the determination of noise distribution in total variation (TV) image denoising. An optimization problem for the determination of the weights correspondent to different types of noise distributions is stated and existence of an optimal solution is proved. A tailored regularization approach for the approximation of the optimal parameter values is proposed thereafter and its consistency studied. Additionally, the differentiability of the solution operator is proved and an optimality system characterizing the optimal solutions of each regularized problem is derived. The optimal parameter values are numerically computed by using a quasi-Newton method, together with semismooth Newton type algorithms for the solution of the TV-subproblems.

We consider a bilevel optimisation approach for parameter learning in higher-order total variation image reconstruction models. Apart from the least squares cost functional, naturally used in bilevel learning, we propose and analyse an alternative cost based on a Huber-regularised TV seminorm. Differentiability properties of the solution operator are verified and a first-order optimality system is derived. Based on the adjoint information, a combined quasiNewton/semismooth Newton algorithm is proposed for the numerical solution of the bilevel problems. Numerical experiments are carried out to show the suitability of our approach and the improved performance of the new cost functional. Thanks to the bilevel optimisation framework, also a detailed comparison between TGV 2 and ICTV is carried out, showing the advantages and shortcomings of both regularisers, depending on the structure of the processed images and their noise level.

We consider the problem of image denoising in the presence of noise whose statistical properties are a combination of two different distributions. We focus on noise distributions that are frequently considered in applications, in particular mixtures of salt & pepper and Gaussian noise, and Gaussian and Poisson noise. We derive a variational image denoising model that features a total variation regularisation term and a data discrepancy that features the mixed noise as an infimal convolution of discrepancy terms of the single-noise distributions. We give a statistical derivation of this model by joint Maximum A-Posteriori (MAP) estimation, and discuss in particular its interpretation as the MAP of a so-called infinity convolution of two noise distributions. Moreover, classical singlenoise models are recovered asymptotically as the weighting parameters go to infinity. The numerical solution of the model is computed using second order Newton-type methods. Numerical results show the decomposition of the noise into its constituting components. The paper is furnished with several numerical experiments and comparisons with other existing methods dealing with the mixed noise case are shown. the Total Variation (TV) as image regulariser, which is a popular choice since the seminal works of Rudin, Osher and Fatemi [50], Chambolle and Lions [17] and Vese [58] due to its edge-preserving and arXiv:1611.00690v2 [math.OC] 20 Nov 2016Proposition 2.4. Let f ∈ L ∞ (Ω), u ∈ BV (Ω) ∩ A and λ 1 , λ 2 > 0. Let A and B be as in (2.5). Then, the minimum in the minimisation problem (2.4) is uniquely attained.Proof. We report the proof in Appendix A It is based on standard tools of calculus of variations and on the properties of Kullback-Leibler divergence recalled in Appendix B.

The liquid and glass states of metal–organic frameworks (MOFs) have recently become of interest due to the potential for liquid-phase separations and ion transport, alongside the fundamental nature of the latter as a new, fourth category of melt-quenched glass. Here we show that the MOF liquid state can be blended with another MOF component, resulting in a domain structured MOF glass with a single, tailorable glass transition. Intra-domain connectivity and short range order is confirmed by nuclear magnetic resonance spectroscopy and pair distribution function measurements. The interfacial binding between MOF domains in the glass state is evidenced by electron tomography, and the relationship between domain size and Tg investigated. Nanoindentation experiments are also performed to place this new class of MOF materials into context with organic blends and inorganic alloys.

We propose the use of the Kantorovich-Rubinstein norm from optimal transport in imaging problems. In particular, we discuss a variational regularisation model endowed with a Kantorovich-Rubinstein discrepancy term and total variation regularization in the context of image denoising and cartoon-texture decomposition. We point out connections of this approach to several other recently proposed methods such as total generalized variation and norms capturing oscillating patterns. We also show that the respective optimization problem can be turned into a convex-concave saddle point problem with simple constraints and hence, can be solved by standard tools. Numerical examples exhibit interesting features and favourable performance for denoising and cartoon-texture decomposition.