An experimental evaluation of peer testing in the context of the teaching of software testing

Barbosa, Juliana Cortez; Valle, Pedro Henrique Dias; Maldonado, José Carlos; Delamaro, Márcio Eduardo; Vincenzi, Auri Marcelo Rizzo

doi:10.1109/siie.2017.8259643

Cited by 3 publications

(2 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Six out of the 14 papers were not peer-reviewed; hence, they are out of the scope of this comparison. Among the other eight papers (14-6) which were peer-reviewed, three of them did not use "systematic" in their titles, abstracts or keywords, and two of them [9,24] were included under the subject area "Engineering" in Scopus. The third search did not find these five papers as the search accepted only systematic reviews and was limited to the subject area "Computer Science" in Scopus.…”

Section: The Third Search and The St Study's Searchmentioning

confidence: 99%

See 1 more Smart Citation

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Tran¹,

Börstler²,

Ali³

et al. 2022

EISEJ

View full text Add to dashboard Cite

Background: Systematic literature studies (SLS) have become a core research methodology in Evidence-based Software Engineering (EBSE). Search completeness, i.e., finding all relevant papers on the topic of interest, has been recognized as one of the most commonly discussed validity issues of SLSs. Aim: This study aims at raising awareness on the issues related to search string construction and on search validation using a quasi-gold standard (QGS). Furthermore, we aim at providing guidelines for search string validation. Method: We use a recently completed tertiary study as a case and complement our findings with the observations from other researchers studying and advancing EBSE. Results: We found that the issue of assessing QGS quality has not seen much attention in the literature, and the validation of automated searches in SLSs could be improved. Hence, we propose to extend the current search validation approach by the additional analysis step of the automated search validation results and provide recommendations for the QGS construction. Conclusion: In this paper, we report on new issues which could affect search completeness in SLSs. Furthermore, the proposed guideline and recommendations could help researchers implement a more reliable search strategy in their SLSs.

show abstract

Section: The Third Search and The St Study's Searchmentioning

confidence: 99%

“…We found that some papers were not categorized correctly according to their subject areas. For example, the ST study found two papers [9,24] that could not be found by the third search (as discussed in Section 5.2). These papers were classified under the subject area Engineering instead of Computer Science.…”

Section: Issues In Search String Constructionmentioning

confidence: 99%

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Tran¹,

Börstler²,

Ali³

et al. 2022

EISEJ

View full text Add to dashboard Cite

show abstract

Mutation Testing and Self/Peer Assessment: Analyzing their Effect on Students in a Software Testing Course

Delgado‐Pérez

Medina‐Bulo

Alvarez-Garcia

et al. 2021

2021 IEEE/ACM 43rd International Conference on Software Engineering: Software Engineering Education and Training (ICSE-SEET)

View full text Add to dashboard Cite

Testing is a crucial activity in the development of software systems. With the increasing complexity of software projects, the industry requires incorporating graduates with adequate testing skills and preparation in this field. A challenge in software testing education is to make students perceive the benefits of writing tests and assess their quality with advanced testing techniques. In this paper, we present an experience integrating both mutation testing and self/peer assessment -two of the most used techniques to that end in the past-into a software testing course during three years. This experience allowed us to analyze the effect of applying these strategies on the students' perception of their manually-written test suites. Noticeably, the computation of the mutation score significantly undermined the initial expectations they had on the developed test suites. Also, the application of peer testing helped them estimate the relative quality of two comparable test suites, as we found a notable correspondence with their respective mutation coverage. Besides, a more in-depth analysis revealed that the students' test suites with more test cases did not always achieve the highest scores, that they found more readable their own tests, and that they tended to cover the basic operations while forgetting about more advanced features. An opinion survey confirmed the impact that the use of mutants had on their perception about testing, and they mostly supported paying a higher level of attention to testing concepts in software engineering degree plans.Index Terms-Software testing education, mutation testing, peer testing, self/peer assessment.

show abstract

Can we use the Flipped Classroom Model to teach Black-box Testing to Computer Students?

Paschoal

Oliveira

Nakagawa

et al. 2019

Proceedings of the XVIII Brazilian Symposium on Software Quality

View full text Add to dashboard Cite

An experimental evaluation of peer testing in the context of the teaching of software testing

Cited by 3 publications

References 10 publications

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

How good are my search strings? Reflections on using an existing review as a quasi-gold standard

Mutation Testing and Self/Peer Assessment: Analyzing their Effect on Students in a Software Testing Course

Can we use the Flipped Classroom Model to teach Black-box Testing to Computer Students?

Contact Info

Product

Resources

About