Well-Posed Bayesian Inverse Problems with Infinitely Divisible and Heavy-Tailed Prior Measures

Abstract

We present a new class of prior measures in connection to p regularization techniques when p ∈ (0, 1) which is based on the generalized Gamma distribution. We show that the resulting prior measure is heavy-tailed, non-convex and infinitely divisible. Motivated by this observation we discuss the class of infinitely divisible prior measures and draw a connection between their tail behavior and the tail behavior of their Lévy measures. Next, we use the laws of pure jump Lévy processes in order to define new classes of prior measures that are concentrated on the space of functions with bounded variation. These priors serve as an alternative to the classic total variation prior and result in well-defined inverse problems. We then study the well-posedness of Bayesian inverse problems in a general enough setting that encompasses the above mentioned classes of prior measures. We establish that well-posedness relies on a balance between the growth of the log-likelihood function and the tail behavior of the prior and apply our results to special cases such as additive noise models and linear problems. Finally, we discuss some of the practical aspects of Bayesian inverse problems such as their consistent approximation and present three concrete examples of well-posed Bayesian inverse problems with heavy-tailed or stochastic process prior measures.

Random Forward Models and Log-Likelihoods in Bayesian Inverse Problems

“…Stability of the posterior with respect to the observed data y and the log-likelihood Φ was established for Gaussian priors by Stuart (2010) and for more general priors by many later contributions (Dashti et al, 2012;Hosseini, 2017;Hosseini and Nigam, 2017;Sullivan, 2017). (We note in passing that the stability of BIPs with respect to perturbation of the prior is possible but much harder to establish, particularly when the data y are highly informative and the normalisation constant Z(y) is close to zero; see e.g.…”

On the local Lipschitz stability of Bayesian inverse problems

“…We now show that by Theorem 10 we obtain well-posedness w.r.t. the Wasserstein distance under the same basic assumption on Φ or , respectively, stated in [7,38] as well as slightly modified in [21,22,40] for establishing well-posedness w.r.t. the Hellinger distance.…”

Enhancing industrial X-ray tomography by data-centric statistical methods

“…Recently, several hierarchical models, which promote more versatile behaviors, have been developed. These include, for example, deep Gaussian processes (Dunlop et al, 2018;Emzir et al, 2020), level-set methods (Dunlop et al, 2017), mixtures of compound Poisson processes and Gaussians (Hosseini, 2017), and stacked Matérn fields via stochastic partial differential equations (Roininen et al, 2019). The problem with hierarchical priors is that in the posteriors, the parameters and hyperparameters may become strongly coupled, which means that vanilla MCMC methods become problematic and, for example, reparameterizations are needed for sampling the posterior efficiently (Chada et al, 2019;Monterrubio-Gómez et al, 2020).…”