Empirical Comparison of Two Metrics Suites for Maintainability Prediction in Packages of Object-Oriented Systems: A Case Study of Open Source Software

Abstract

Software maintainability has been an important external quality attribute that concerns both styles of software development, the proprietary model as well as open source. As lots of open source software are predominantly built using the OO paradigm, there exists a need for empirical validation with respect to certain quality aspects especially maintainability. There are a few studies in the past which use code metrics and a few which use design metrics, much earlier in the software development life cycle to predict maintainability. In addition, there are studies which apply both code as well as design metrics to evaluate maintainability. The objective of this research is to perform an empirical comparison of two popular OO metrics suites, the Martin suite and the CK suite on four open source software systems by analysing a few key design metrics such as size, coupling, complexity, inheritance and stability. Two important observations were made with this empirical study. First, between the two OO suite of design metrics, the prediction model developed using Martin metrics scores better than the model developed using the CK suite. Second, the combination of Martin and CK suites is helpful in predicting the maintainability of OO software, with a predictive accuracy of 66.7%, better than that of the models constructed by either Martin metrics or by the CK metrics individually.

Applying Machine Learning Techniques to Predict the Maintainability of Open-Source Software

“…They found evidence of prediction models constructed using the Martin suite to be more accurate when compared to models built using the CK and MOOD suites. Madhwaraj [19] performed a study to compare the performance of two OO suites and found that prediction models obtained from the Martin suite were performing better than the prediction models obtained from the Chidamber and Kemerer suite. Madhwaraj [20] has also performed a case study on jfreechart software and proposed a predictive model for maintainability.…”

“…Some research works have been done by using certain design metrics from different suites. There are also works which use an entire metric suite and understand the influence of a suite in its entirety on software maintainability [19,20]. Some of the popular OO metric suites are the Martin suite, CK suite, and the MOOD suite.…”