Improving the Confidence in Measurement-Based Timing Analysis

Bünte, Sven; Zolda, Michael; Tautschnig, Michael; Kirner, Raimund

doi:10.1109/isorc.2011.27

Cited by 18 publications

(19 citation statements)

References 18 publications

(15 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Bünte et al [3] examined the efectiveness of using model checking [10] to produce test suites with enough coverage to provide reliable WCET estimates. Their research focuses on identifying efective coverage metrics to drive a model checking test suite generator.…”

Section: Automatic Test Case Generationmentioning

confidence: 99%

Taco

Lesage

Law

Bate

2018

Proceedings of the 26th International Conference on Real-Time Networks and Systems

View full text Add to dashboard Cite

Timing analysis is an important part of the development of critical real-time systems. It stems from the need to provide evidence on the behaviour of the system, compliance to requirements and timing bounds. The formal testing process is complicated, and includes tests to achieve compliance with certiication requirements. Where possible, testing should be performed on a host and then validated on the target. This is especially important for real systems where the target may not be available early in the project or target-based testing is expensive and time consuming. Meaningful host-based testing is diicult when it comes to timing analysis. Automation helps reduce the costs and move testing earlier in the application development cycle. Moving testing earlier in the development cycle not only enables the testing to scale to whole systems, it allows the risks of projects to be managed and software to be optimised before target-based testing is performed.In this paper, we extend existing work achieving reliable coverage and High WaterMark (HWM) measurement, to scale its application to the analysis of a full system software build, automate the test process, and minimise the set of tests deployed on target. Our case study demonstrates the successful application of the approach on a large code base, i.e. an existing controls system software code. The paper ends with a position statement about how this work is instrumental for both future research but also as part of industry practically analysing the timing behaviour of systems automatically and certifying mixed-criticality systems.

show abstract

Section: Automatic Test Case Generationmentioning

confidence: 99%

Taco

Lesage

Law

Bate

2018

Proceedings of the 26th International Conference on Real-Time Networks and Systems

View full text Add to dashboard Cite

show abstract

“…Some works a empt to reduce programs to a single execution path building on constant-time predicated instructions [28], but its requirements and cost are di cult to leverage with industrial practice. Other approaches, instead, use genetic algorithms and model checking to generate input vectors to achieve full path coverage [4,36], but con dence on the results is limited due to their heuristic nature. In the context of MBPTA, only PUB [14] and EPC [38] have been proposed to achieve full path coverage.…”

Section: Related Workmentioning

confidence: 99%

Measurement-based cache representativeness on multipath programs

Milutinović

Abella

Mezzetti

et al. 2018

Proceedings of the 55th Annual Design Automation Conference

View full text Add to dashboard Cite

Autonomous vehicles in embedded real-time systems increase criticalso ware size and complexity whose performance needs are covered with high-performance hardware features like caches, which however hampers obtaining WCET estimates that hold valid for all program execution paths.is requires assessing that all cache layouts have been properly factored in the WCET process. For measurement-based timing analysis, the most common analysis method, we provide a solution to achieve cache representativeness and full path coverage: we create a modi ed program for analysis purposes where cache impact is upper-bounded across any path, and derive the minimum number of runs required to capture in the test campaign cache layouts resulting in high execution times.

show abstract

“…This however poses some requirements on the platform and compiler infrastructure, which might break consolidated industrial practice. On the opposite side of the spectrum of potential solutions, methods based on genetic algorithms and model checking have been proposed, with alternate fortune, in the last years to automatically generate the input vectors required to achieve full path coverage [28], [29]. However, the genetic algorithm these methods rely on are generally exposed to local minima/maxima that can prevent them from being successfully applied.…”

Section: Related Workmentioning

confidence: 99%

EPC Enacted: Integration in an Industrial Toolbox and Use against a Railway Application

Mezzetti

Fernandez

Bardizbanyan³

et al. 2017

2017 IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS)

View full text Add to dashboard Cite

Abstract-Measurement-based timing analysis approaches are increasingly making their way into several industrial domains on account of their good cost-benefit ratio. The trustworthiness of those methods, however, suffers from the limitation that their results are only valid for the particular paths and execution conditions that the user is able to explore with the available input vectors. It is generally not possible to guarantee that the collected measurements are fully representative of the worst-case timing behaviour.In the context of measurement-based probabilistic timing analysis, the Extended Path Coverage (EPC) approach has been recently proposed as a means to extend the representativeness of measurement observations, to obtain the same effect of full path coverage. At the time of its first publication, EPC had not reached an implementation maturity that could be trialled industrially. In this work we analyze the practical implications of using EPC with real-world applications, and discuss the challenges in integrating it in an industrial-quality toolchain. We show that we were able to meet EPC requirements and successfully evaluate the technique on a real Railway application, on top of a commercial toolchain and full execution stack.

show abstract

Improving the Confidence in Measurement-Based Timing Analysis

Cited by 18 publications

References 18 publications

Taco

Taco

Measurement-based cache representativeness on multipath programs

EPC Enacted: Integration in an Industrial Toolbox and Use against a Railway Application

Contact Info

Product

Resources

About