Central Limit Model Checking

Abstract

We consider probabilistic model checking for continuoustime Markov chains (CTMCs) induced from Stochastic Reaction Networks (SRNs) against a fragment of Continuous Stochastic Logic (CSL) extended with reward operators. Classical numerical algorithms for CSL model checking based on uniformisation are limited to finite CTMCs and suffer from exponential growth of the state space with respect to the number of species. On the other hand, approximate techniques such as mean-field approximations and simulations combined with statistical inference are more scalable, but can be time consuming and do not support the full expressiveness of CSL. In this paper we employ a continuousspace approximation of the CTMC in terms of a Gaussian process based on the Central Limit Approximation (CLA), also known as the Linear Noise Approximation (LNA), whose solution requires solving a number of differential equations that is quadratic in the number of species and independent of the population size. We then develop efficient and scalable approximate model checking algorithms on the resulting Gaussian process, where we restrict the target regions for probabilistic reachability to convex polytopes. This allows us to derive an abstraction in terms of a time-inhomogeneous discrete-time Markov chain (DTMC), whose dimension is independent of the number of species, on which model checking is performed. Using results from probability theory, we prove the convergence in distribution of our algorithms to the corresponding measures on the original CTMC. We implement the techniques and, on a set of examples, demonstrate that they allow us to overcome the state space explosion problem, while still correctly characterizing the stochastic behaviour of the system. Our methods can be used for formal analysis of a wide range of distributed stochastic systems, including biochemical systems, sensor networks and population protocols.

Handling State Space Explosion in Component-Based Software Verification: A Review

“…Another kind of heuristic model-checking method to mitigate SSE found through the search result is the continuoustime Markov chain [44], [45]. A hybrid metaheuristic approach is also presented in [46].…”

A Language for Modeling and Optimizing Experimental Biological Protocols

“…A Gaussian process is a collection of random variables, such that every finite linear combination of them is normally distributed. Given a state of a CRN, its time evolution from that state can be described by a Gaussian process indexed by time whose mean and variance are given by a linear noise approximation (LNA) of the Chemical Master Equation (CME) [7,18] and is formally defined in the following definitions of CRN Flux and CRN Time Evolution.…”

A Language for Modeling And Optimizing Experimental Biological Protocols

“…A Gaussian process is a collection of random variables, such that every finite linear combination of them is normally distributed. Given a state of a CRN its time evolution from that state can be described by a Gaussian process indexed by time whose mean and variance are given by a Linear Noise Approximation (LNA) of the Chemical Master Equation (CME) [7,18] and is formally defined in the following definitions of CRN Flux and CRN Time Evolution. Definition 3.…”