A Comparative Study of Model-Driven Approaches For Scoping and Planning Experiments

Resources for Reproducibility of Experiments in Empirical Software Engineering: Topics Derived From a Secondary Study

“…• PICO and GQM are adopted for guidelines to help researchers to identify, define, and evaluate research goals [16], [26].…”

“…• Another approach to support guidelines scoping and planning is the use of model-driven for ''experiment protocols'' [16].…”

“…• For improving the understanding and reviewing of replication packaging, ontologies such as ExpertOntology are used [16].…”

“…As knowledge refers to more complex information, it needs more complex tools that enable tracking changes and time [30]. In this way, several proposals have been developed, for example: FIRE (Framework for replication of experiments) [8], eSEE (Experimental Software Engineering Environment) [16], [31], ARREST (Application or Reproducible Research on Evaluation of Software Testing Techniques) [7], and TraceLab framework (for feature extraction techniques) [32]. In general, all these tools are integrated environments for domain-oriented software engineering experiments; therefore, they include the entire research workflow, a collection of artifacts, allow instantiation and distribution of experiments, and they are specialized [24].…”

“…Accordingly, our study aims to identify tools that maximize reproducibility in software engineering experiments and how they are applied. As a guide for achieving this goal, we established three research questions following the evidence-based research practices [16] (see Table 1).…”