WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation

Rothermel, Karen J.; Cook, Curtis R.; Burnett, Margaret; Schonfeld, Justin; Green, T.R.G.; Rothermel, Gregg

doi:10.1109/icse.2000.870414

Cited by 48 publications

(54 citation statements)

References 23 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the WYSIWYT system users can indicate incorrect output values by placing a faulty token in the cell. Similarly, they can indicate that the value in a cell is correct by placing a correct token [18]. When a user indicates one or more program failures during this testing process, fault localization techniques direct the user's attention to the possible faulty cells.…”

Section: Related Workmentioning

confidence: 99%

On the Empirical Evaluation of Fault Localization Techniques for Spreadsheets

Hofer

Riboira

Wotawa

et al. 2013

Fundamental Approaches to Software Engineering

View full text Add to dashboard Cite

Abstract. Spreadsheets are by far the most prominent example of enduser programs of ample size and substantial structural complexity. In addition, spreadsheets are usually not tested very rigorously and thus comprise faults. Locating faults is a hard task due to the size and the structure, which is usually not directly visible to the user, i.e., the functions are hidden behind the cells and only the computed values are presented. Hence, there is a strong need for debugging support. In this paper, we adapt three program-debugging approaches that have been designed for more traditional procedural or object-oriented programming languages. These techniques are Spectrum-based Fault Localization, Spectrum-Enhanced Dynamic Slicing, and Constraint-based Debugging. Beside the theoretical foundations, we present a more sophisticated empirical evaluation including a comparison of these approaches. The empirical evaluation shows that Sfl (Spectrum-based Fault Localization) and Sendys (Spectrum ENhanced Dynamic Slicing) are the most promising techniques.

show abstract

Section: Related Workmentioning

confidence: 99%

On the Empirical Evaluation of Fault Localization Techniques for Spreadsheets

Hofer

Riboira

Wotawa

et al. 2013

Fundamental Approaches to Software Engineering

View full text Add to dashboard Cite

show abstract

“…In the WYSIWYT system, users indicate correct/incorrect output values by placing a correct/faulty token in the cell [21]. The spreadsheet analysis tools of Abraham and Ewig [2] and Ahmad et al [4] reason about the units of cells to find inconsistencies in formulas.…”

Section: Related Workmentioning

confidence: 99%

Testing for Distinguishing Repair Candidates in Spreadsheets – the Mussco Approach

Abreu

Auβerlechner

Hofer

et al. 2015

Testing Software and Systems

View full text Add to dashboard Cite

“…The WYSIWYT methodology provides feedback about the "testedness" of cells in spreadsheets in a way that is incremental, responsive, and entirely visual. Empirical studies have shown that this methodology can help end users test their spreadsheets more adequately and more efficiently, and detect faults in their spreadsheets [30,46]. In subsequent work, we have extended the approach to apply to large grids of cells with shared formulas [11,10] and to incorporate re-use of test cases [21].…”

Section: Introductionmentioning

confidence: 99%

Integrating automated test generation into the WYSIWYT spreadsheet testing methodology

Fisher

Rothermel

Brown

et al. 2006

ACM Trans. Softw. Eng. Methodol.

View full text Add to dashboard Cite

Spreadsheet languages, which include commercial spreadsheets and various research systems, have had a substantial impact on end-user computing. Research shows, however, that spreadsheets often contain faults. Thus, in previous work, we presented a methodology that helps spreadsheet users test their spreadsheet formulas. Our empirical studies have shown that end users can use this methodology to test spreadsheets more adequately and efficiently; however, the process of generating test cases can still represent a significant impediment. To address this problem, we have been investigating how to incorporate automated test case generation into our testing methodology in ways that support incremental testing and provide immediate visual feedback. We have utilized two techniques for generating test cases, one involving random selection and one involving a goal-oriented approach. We describe these techniques and their integration into our testing environment, and report results of an experiment examining their effectiveness and efficiency.

show abstract

WYSIWYT testing in the spreadsheet paradigm: an empirical evaluation

Cited by 48 publications

References 23 publications

On the Empirical Evaluation of Fault Localization Techniques for Spreadsheets

On the Empirical Evaluation of Fault Localization Techniques for Spreadsheets

Testing for Distinguishing Repair Candidates in Spreadsheets – the Mussco Approach

Integrating automated test generation into the WYSIWYT spreadsheet testing methodology

Contact Info

Product

Resources

About