Model-Based Testing for Objective Fidelity Evaluation of Engineering and Research Flight Simulators

Durak, Umut; Schmidt, Artur; Pawletta, Thorsten

doi:10.2514/6.2015-2948

Cited by 7 publications

(6 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…33 The subsequent sections extend our previous research. 19,24,26 3.1 Specification of a set of test scenarios using the SES /MB approach…”

Section: Mbt For Objective Fidelity Evaluation Using the Ses/mb Framementioning

confidence: 99%

“…This section starts with the concept of an MBT infrastructure for systematic and automated objective fidelity evaluation of modular CPS models based on the introduced approaches and our previous work in. 19,26 Subsequently, the general procedure of a test process using the suggested infrastructure is shown. Figure 8 illustrates the concept of the suggested infrastructure.…”

Section: Concept Of An Mbt Infrastructure Based On the Ses/mb Frameworkmentioning

confidence: 99%

“…An initial sketch of MBT using SES Toolbox for MATLAB/ Simulink with a sample application in robotics domain is presented by Schmidt et al 19 Then the approach is exercised in an objective fidelity evaluation of a flight simulation model. 26 In light of the previous studies, this paper endeavors to present a more elaborated MBT methodology based on SES, EF and MB for testing complex, modular CPS models where testing standards or other kinds of data for fidelity evaluation are available. However, the main contribution is a novel prototype infrastructure within MATLAB/Simulink for automated MBT based on the elaborated methodology.…”

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Model-based testing methodology using system entity structures for MATLAB/Simulink models

2016

Self Cite

View full text Add to dashboard Cite

The increasing complexity of systems entails an increasing complexity of simulation models. Likewise, heterogeneity in system components corresponds to heterogeneous simulation models. Cyber physical systems (CPS) represent an emerging class of technical systems characterized by their complexity and heterogeneity. Developing simulation models for CPS brings various challenges, one of which is determining the simulation fidelity. Fidelity evaluation can be introduced as the degree to which a simulation model matches the characteristics of the system it represents. Due to the growth of system complexity in CPS, the number of test cases required to reach admissible coverage to assure adequate simulation fidelity is very high. Along with that, heterogeneity in system components comes on top as another challenge. Therefore, adaptability, flexibility and automation can be identified as the key characteristics of a fidelity evaluation approach that determines its success. Model-based testing (MBT) advocates the use of models for the specification of test cases and proposes workflows for automatic test case generation. This paper presents an MBT approach for objective fidelity evaluation of complex, modular simulation models. The methodology implies that appropriate data for fidelity evaluation are available. Each test model is represented according to the formal structure of experimental frame (EF). For generating an executable EF for a model under test (MUT), configurable basic models are provided by a model base (MB). In the same manner, configurable basic models for composing various MUTs are stored in the MB. The system entity structure (SES) ontology is used for the specification of a family of MUT and test model designs on an abstract level. This means that the SES describes a set of various MUT and test model structures and parameter settings. Using the SES and MB, a specific executable model consisting of an MUT and a test model can be generated. Based on these ideas an infrastructure implementation for automated fidelity evaluation of complex, modular simulation models within MATLAB/Simulink is proposed in this paper.

show abstract

“…33 The subsequent sections extend our previous research. 19,24,26 3.1 Specification of a set of test scenarios using the SES /MB approach…”

Section: Mbt For Objective Fidelity Evaluation Using the Ses/mb Framementioning

confidence: 99%

Section: Concept Of An Mbt Infrastructure Based On the Ses/mb Frameworkmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Model-based testing methodology using system entity structures for MATLAB/Simulink models

2016

Self Cite

View full text Add to dashboard Cite

show abstract

“…Many studies have been conducted on IF from different disciplines [33]; in education [34], social work [35], engineering [36], construction [37] and health [16,38,39], the area of this study. IF is important in the process of translating evidence-based interventions into real-life practice.…”

Section: Introductionmentioning

confidence: 99%

Fidelity of implementation of TB screening guidelines by health providers at selected HIV clinics in Ghana

et al. 2021

View full text Add to dashboard Cite

Introduction Tuberculosis screening of people living with human immunodeficiency virus is an intervention recommended by the WHO to control the dual epidemic of TB and HIV. The extent to which the intervention is adhered to by the HIV healthcare providers (fidelity) determines the intervention’s effectiveness as measured by patient outcomes, but literature on fidelity is scarce. This study assessed provider implementation fidelity to national guidelines on TB screening at HIV clinics in Ghana. Methods It was a cross-sectional study that used structured questionnaires to gather data, involving 226 of 243 HIV healthcare providers in 27 HIV clinics across Ghana. The overall fidelity score comprised sixteen items with a maximum score of 48 grouped into three components of the screening intervention (TB diagnosis, TB awareness and TB symptoms questionnaire). Simple summation of item scores was done to determine fidelity score per provider. In this paper, we define the level of fidelity as low if the scores were below the median score and were otherwise categorized as high. Background factors potentially associated with implementation fidelity level were assessed using cluster-based logistic regression. Odds ratio with 95% confidence interval (CI) was used as the measure of association. Results Of the 226 healthcare providers interviewed, 60% (135) were females with a mean age of 34.5 years (SD = 8.3). Most of them were clinicians [63% (142)] and had post-secondary non-tertiary education [62% (141)]. Overall, 53% (119) of the healthcare providers were categorized to have implemented the intervention with high fidelity. Also, 56% (126), 53% (120), and 59% (134) of the providers implemented the TB diagnosis, TB awareness and TB symptoms questionnaire components respectively with high fidelity. After adjusting for cluster effect, female providers (AOR = 2.36, 95%CI: 1.09–5.10, p = <0.029), those with tertiary education (AOR = 4.31, 95%CI: 2.12–9.10, p = 0.040), and clinicians (AOR = 1.78, 95%CI: 1.07–3.50, p = 0.045) were more likely to adhere to the guidelines compared to their counterparts. Conclusion The number of providers with fidelity scores above the median was marginally greater (6%) than the number with fidelity score below the median. Similarly, for each of the components, the number of providers with fidelity scores higher than the median was marginally higher. This could explain the existing fluctuations in the intervention outcomes in Ghana. We found gender, profession and education were associated with provider implementation fidelity. To improve fidelity level among HIV healthcare providers, and realize the aims of the TB screening intervention among PLHIV in Ghana, further training on implementing all components of the intervention is critical.

show abstract

“…SES is a high level ontology which was introduced to specify a set of system structures and parameter settings. It has long been used for modeling variable-structure systems and was recently applied to problems of model-based simulation system engineering such as model-based testing 6,7 and variability management. 8 The background section introduces the simulation scenario development and the SES.…”

Section: Introductionmentioning

confidence: 99%

Using System Entity Structures to Model the Elements of a Scenario in a Research Flight Simulator

Durak

Pruter

Gerlach

et al. 2017

AIAA Modeling and Simulation Technologies Conference

Self Cite

View full text Add to dashboard Cite

While any simulation study starts with a scenario, scenario development is usually conducted in an unstructured and ad hoc manner. In order to streamline scenario development, a formal approach is envisioned in the research flight simulator facility of German Aerospace Center (DLR), namely Air Vehicle Simulator (AVES). System Entity Structure (SES) which is a high level ontology that was introduced to specify a set of system structures and parameter settings is proposed as the foundations. The paper outlines a model-based methodology for scenario development. SES is exploited for metamodeling in order to capture all possible elements of a scenario that can be simulated in AVES. Then a scenario modeling methodology is built upon this metamodel.

show abstract

Model-Based Testing for Objective Fidelity Evaluation of Engineering and Research Flight Simulators

Cited by 7 publications

References 17 publications

Model-based testing methodology using system entity structures for MATLAB/Simulink models

Model-based testing methodology using system entity structures for MATLAB/Simulink models

Fidelity of implementation of TB screening guidelines by health providers at selected HIV clinics in Ghana

Using System Entity Structures to Model the Elements of a Scenario in a Research Flight Simulator

Contact Info

Product

Resources

About