Verification and Validation

Best practices for US Department of Defense model validation: lessons learned from irregular warfare models

“…First, we suggest that DoD’s process for model validation be partitioned into conceptual and operational validation, as suggested by Sargent. 19 Second, we adapted the work of Petty 20 to provide a conceptual framework (see Figure 1) for identifying best practices.…”

“…The simuland is the real-world system of interest, including the objects, processes, or phenomena to be simulated. 20 As such, it is the real-world context for the user needs; i.e. the context within which the user’s problem or capability gap exists that requires a solution.…”

“…A primary validation activity identified by Petty 20 is the comparison of the simuland and the conceptual model to determine if the conceptual model captures all the key concepts, objects, relationships, and dynamics from the real-world necessary to address the intended use for the model. Because referents are descriptions of what is known about the simuland in the context of the intended use, the comparison of interest is more precisely between the referent(s) and the conceptual model.…”

“…with respect to objects, object characterization, object relationships, algorithms, data, etc.) and IF the model implementation is verified to be a correct implementation of the conceptual model, THEN perforce the model results must be valid against the simuland (Petty’s 20 other major validation comparison). If the conceptual model is an appropriate representation of the referent(s), including the logic and computations to produce valid results, also based on the referent(s), and if the software design and development activities successfully implement precisely that conceptual model, then the software will also produce valid results (the same ones produced by the logic and algorithms of the specified conceptual model).…”

Composability Verification of Real Time System Models Using Colored Petri Nets

“…It is typically defined as a process of determining whether the model has been implemented correctly [9] and whether it is consistent with its specifications [10]. In principle, verification is concerned into a conceptual model and the conceptual model into an requirements are identified by means of requirements specification which includes a set of verification goals, listed in terms of desired system behavior properties such as deadlock freedom, live-lock freedom, mutual exclusion and fairness.…”