Robustness of Model-Based Simulations

We present a Monte-Carlo optimization technique for finding inputs to a system that falsify a given Metric Temporal Logic (MTL) property. Our approach performs a random walk over the space of inputs guided by a robustness metric defined by the MTL property. Robustness can be used to guide our search for a falsifying trajectory by exploring trajectories with smaller robustness values. We show that the notion of robustness can be generalized to consider hybrid system trajectories. The resulting testing framework can be applied to non-linear hybrid systems with external inputs. We show through numerous experiments on complex systems that using our framework can help automatically falsify properties with more consistency as compared to other means such as uniform sampling.

show abstract

“…[13]. Then, these bounds can be used to provide bounds on the robustness of the actual continuous-time trajectory [12].…”

Section: Computing Robustnessmentioning

confidence: 99%

Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems

Nghiem

Sankaranarayanan

Fainekos

et al. 2010

Proceedings of the 13th ACM International Conference on Hybrid Systems: Computation and Control

Self Cite

124

133

View full text Add to dashboard Cite

show abstract

“…In [2], the authors propose another approach of combining space and time robustness, by extending STL with averaged temporal operators. Another approach to determining robustness of hybrid systems using self-validated arithmetics is shown in [19]. Monitoring of different quantitative semantics is implemented in tools such as S-TaLiRo [4] and Breach [13].…”

Section: Related Workmentioning

confidence: 99%

Quantitative monitoring of STL with edit distance

Jakšić

Bartocci

Grosu

et al. 2018

Form Methods Syst Des

View full text Add to dashboard Cite

In cyber-physical systems (CPS), physical behaviors are typically controlled by digital hardware. As a consequence, continuous behaviors are discretized by sampling and quantization prior to their processing. Quantifying the similarity between CPS behaviors and their specification is an important ingredient in evaluating correctness and quality of such systems. We propose a novel procedure for measuring robustness between digitized CPS signals and signal temporal logic (STL) specifications. We first equip STL with quantitative semantics based on the weighted edit distance, a metric that quantifies both space and time mismatches between digitized CPS behaviors. We then develop a dynamic programming algorithm for computing the robustness degree between digitized signals and STL specifications. In order to promote hardware-based monitors we implemented our approach in FPGA. We evaluated it on automotive benchmarks defined by research community, and also on realistic data obtained from magnetic sensor used in modern cars.

show abstract

“…In some practical examples it does not suffice to find an optimal solution unless it is also robust (see [12,11] for various definitions of robustness). Intuitively, we say that a set of model parameters is robust if a small variation at the values of the model parameters does not affect the validity of the formula under consideration.…”

Section: Parameter Optimisationmentioning

confidence: 99%

Synthesising optimal timing delays for timed I/O automata

Diciolla

Kim

Kwiatkowska

et al. 2014

Proceedings of the 14th International Conference on Embedded Software

View full text Add to dashboard Cite

In many real-time embedded systems, the choice of values for the timing delays can crucially affect the safety or quantitative characteristics of their execution. We propose a parameter synthesis algorithm that finds optimal timing delays guaranteeing that the system satisfies a given quantitative property. As a modelling framework we consider networks of Timed Input/Output Automata (TIOA) with priorities and parametric guards. To express system properties we extend Metric Temporal Logic (MTL) with counting formulas. We implement the algorithm using constraint solving and Monte Carlo sampling, and demonstrate the feasibility of our approach on a simplified model of a pacemaker. We are able to synthesise timing delays that ensure with high probability that energy usage is minimised, while maintaining the basic safety property of the pacemaker.

show abstract

Robustness of Model-Based Simulations

Cited by 17 publications

References 27 publications

Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems

Monte-carlo techniques for falsification of temporal properties of non-linear hybrid systems

Quantitative monitoring of STL with edit distance

Synthesising optimal timing delays for timed I/O automata

Contact Info

Product

Resources

About