Empirical evaluation of software testing techniques in an open source fashion

Abstract

Testing technique selection and evaluation remains a key issue in software testing. Industry practitioners need concrete evidence to select proper testing techniques in STLC. Despite the large number of empirical studies which attempt to study the testing techniques' applicability conditions and allied factors, we are still without realistic and generalized results as studies lack a formal foundation and are not complete in all respects. Additionally, besides varying significantly in terms of parameters they have taken into consideration, many existing studies show contradictory results. Even though the researchers stress on replication of these studies under a common set of guidelines, however, attempts to aggregate results from such replications still has not been fruitful so far. As such, to bridge the gap between researchers and industry professionals, we propose to carry out evaluation of testing techniques on a large scale under a unified framework in an open-source fashion so that the realistic and generalized results are obtained in a shorter span of time.

Um framework para avaliação sistemática de técnicas de teste no contexto de programação concorrente

“…No contexto de programas sequenciais, inúmeras pesquisas foram desenvolvidas com o intuito de definir técnicas e critérios para validação e teste de programas, bem como estudos para avaliar as propostas (HERMAN, 1976;HOWDEN, 1976;MCCABE, 1976;DEMILLO et al, 1978;RAPPS;WEYUKER, 1982;HALEY;ZWEBEN, 1984;NTAFOS, 1984;WEYUKER et al, 1991;MALDONADO et al, 1992;DELAMARO et al, 2001;RICCA;TONELLA, 2001;FERRARI et al, 2008;LEMOS et al, 2009;FAROOQ;QUADRI, 2014). Esses trabalhos oferecem fundamentos básicos e norteiam a criação de novas técnicas e critérios de teste para outros domínios de desenvolvimento.…”