Defect Data Analysis Based on Extended Association Rule Mining

Abstract

This paper describes an empirical study to reveal rules associated with defect correction effort. We defined defect correction effort as a quantitative (ratio scale) variable, and extended conventional (nominal scale based) association rule mining to directly handle such quantitative variables. An extended rule describes the statistical characteristic of a ratio or interval scale variable in the consequent part of the rule by its mean value and standard deviation so that conditions producing distinctive statistics can be discovered. As an analysis target, we collected various attributes of about 1,200 defects found in a typical medium-scale, multi-vendor (distance development) information system development project in Japan. Our findings based on extracted rules include: (1)Defects detected in coding/unit testing were easily corrected (less than 7% of mean effort) when they are related to data output or validation of input data. (2)Nevertheless, they sometimes required much more effort (lift of standard deviation was 5.845) in case of low reproducibility, (3)Defects introduced in coding/unit testing often required large correction effort (mean was 12.596 staff-hours and standard deviation was 25.716) when they were related to data handing. From these findings, we confirmed that we need to pay attention to types of defects having large mean effort as well as those having large standard deviation of effort since such defects sometimes cause excess effort.

How Much Effort Needed to Fix the Bug? A Data Mining Approach for Effort Estimation and Analysing of Bug Report Attributes in Firefox

“…Adrian Bachmann, et al, [9] explored the process data quality and characteristics which have an influence on the bug fixing process and the process quality as measured by the process data influence on the product quality. Shuji Morisaki, et al, [10] described the study to reveal rules associated with defect correction effort and describes the extracted rules like a higher severity defect requires greater correction effort; defects detected in coding unit testing, were easily corrected. Syed Nadeem Ahsan, et al, [11] …”

The MSR Cookbook: Mining a decade of research

“…If this is not possible, then at least somebody outside the research group should perform the manual verification [14]. It is also suggested that rigorous inspection and testing is applied to the source code and scripts that implement the analysis approach since wrong output might not necessarily be due to poor heuristics, but simply due to defective implementations [44]. Finally, researchers suggest normalization in many scenarios.…”

A Heuristic Rule Reduction Approach to Software Fault-proneness Prediction

“…Morisaki et al [14] proposed an extended association rule mining method that takes advantage of interval and ratio scale variables, instead of simply replacing them into nominal or ordinal variables. In the proposed method, an extended rule describes the statistical characteristic of quantitative variables (e.g.…”

“…We used NEEDLE [14] as an association rule miner. To obtain an initial rule set (for applying rule reduction methods,) rules were mined from Mylyn v.1.0 dataset with threshold values: minimum support  support = .01 and minimum confidence  confidence = .75.…”