An Iterative Empirical Strategy for the Systematic Selection of a Combination of Verification and Validation Technologies

Wojcicki, Margaret A.; Strooper, Paul

doi:10.1109/wosq.2007.4

Cited by 21 publications

(9 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…To take advantage of the benefits and reduce the limitations of these separate approaches, we are currently working on a strategy to select and evaluate V&V combinations systematically [22]. The strategy focuses on maximising completeness and minimising effort using metrics such as effort and defect-detection effectiveness.…”

Section: Iterative Methods For Selecting and Evaluating Vandv Technologymentioning

confidence: 99%

Selecting V&V Technology Combinations: How to Pick a Winner?

Strooper¹,

Wojcicki²

2007

12th IEEE International Conference on Engineering Complex Computer Systems (ICECCS 2007)

Self Cite

View full text Add to dashboard Cite

Numerous software verification and validation (V&V) techniques and tools exist to analyse requirements, designs and implementations of software systems. These V&V technologies range from relatively lightweight ones, such as inspection and testing, to more heavyweight technologies based on formal methods and theorem proving. For complex systems, a significant part of the cost and effort for development and maintenance is associated with V&V activities, and this almost always involves selecting and applying a mix of V&V technologies. Unfortunately, little is known about the cost-effectiveness of individual technologies or how to derive the most cost-effective combination. As such, combinations for particular projects are typically selected in an ad-hoc way.In this paper, several issues related to the selection and evaluation of combinations of V&V technologies are explored, based on personal experiences with the V&V of concurrent Java components. A V&V method is presented that was systematically derived through an analysis of the possible failures that can occur in concurrent Java components. This method combines inspection, static analysis, and dynamic testing. In addition, empirical methods that use analysis of fault data and experiments to evaluate V&V combinations are presented. Finally, ideas are presented for an iterative method that can be used to assist with both the selection and evaluation of cost-effective V&V combinations in a given context.

show abstract

Section: Iterative Methods For Selecting and Evaluating Vandv Technologymentioning

confidence: 99%

Selecting V&V Technology Combinations: How to Pick a Winner?

Strooper¹,

Wojcicki²

2007

12th IEEE International Conference on Engineering Complex Computer Systems (ICECCS 2007)

Self Cite

View full text Add to dashboard Cite

show abstract

“…• this approach is only applicable to the testing phase of the software development life cycle, model V&V, however, should be conducted as a continuous activity throughout the M&S life cycle; • this scheme is designed specifically for characterizing testing case strategies, other types of techniques like inspections, reviews, and walkthroughs are hard to characterize; • the attributes in the scheme are defined for software projects and are not always applicable to a simulation study; • the selection of more than one testing technique is not possible for a given (software) project (Dias-Neto and Travassos 2009); • no process is associated with the scheme to support the techniques selection (Wojcicki and Strooper 2007).…”

Section: Characterization Of Vandv Techniquesmentioning

confidence: 99%

Selecting verification and validation techniques for simulation projects: A planning and tailoring strategy

Wang¹

2013

2013 Winter Simulations Conference (WSC)

View full text Add to dashboard Cite

Conducting verification and validation (V&V) of modeling and simulation (M&S) requires systematic and structured application of different V&V techniques throughout the M&S life cycle. Whether an existing technique is appropriate to a particular V&V activity depends not only on the characteristics of the technique but also on the situation where it will be applied. Although there already exit several guidance documents describing a variety of V&V techniques and their application potential, accessible findings or experiences on the effective selection of suitable V&V techniques for a given M&S context are still lacking. This paper presents: 1.) a characterization approach to developing a V&V techniques catalog that packages the available techniques together with the information about their application conditions; and 2.) a planning and tailoring strategy for project-specific selection of the appropriate V&V techniques from the established catalog according to the goals and characteristics of a simulation study.

show abstract

“…The category test strategy includes three articles [32,123,150]. Wojcicki and Strooper [32] propose a systematic strategy for selecting certain verification and validation (V&V) combinations.…”

Section: Category Test Strategymentioning

confidence: 99%

“…Wojcicki and Strooper [32] propose a systematic strategy for selecting certain verification and validation (V&V) combinations. For the user, it is important to know how the available V&V techniques should be combined in order to make testing activities effective and efficient.…”

Section: Category Test Strategymentioning

confidence: 99%