A model for analyzing performance problems and root causes in the personal software process

Abstract

High-maturity software development processes, such as the Team Software Process and the accompanying Personal Software Process (PSP), can generate significant amounts of data that can be periodically analyzed to identify performance problems, determine their root causes, and devise improvement actions. However, there is a lack of tool support for automating that type of analysis, and hence diminish the manual effort and expert knowledge required. So, we propose in this paper a comprehensive performance model, addressing time estimation accuracy, quality, and productivity, to enable the automated (tool based) analysis of performance data produced by PSP developers, namely, identify and rank performance problems and their root causes. A PSP data set referring to more than 30 000 projects was used to validate and calibrate the model.

Empirical Evaluation of the ProcessPAIR Tool for Automated Performance Analysis

“…The statistical distribution of each PI and statistical relations between PIs are computed from the data set [8].…”

“…To best fit the specific context of PSP training in Tec de Monterrey, we used the PSP performance model defined in our previous work [8] with minor changes. The full set of top-level and nested PIs can be seen in the first column of Figure 2.…”

“…Hence, the latter PIs are presented in Figure 2 as child nodes of the Time Estimation Accuracy. The rational for further drilling down the Productivity Estimation Accuracy can be consulted in [8].…”

“…To address those shortcomings, in previous work [7] [8] we developed models, techniques, and tools to automate the analysis of performance data produced in the context of high maturity software development processes. The developed ProcessPAIR tool, available freely in http://blogs.fe.up.pt/processpair/, is able to automatically identify and rank performance problems and potential root causes of individual developers in their performance data.…”

“…Define: Process experts define the structure of a performance model (PM) suited for the development process under consideration (TSP, PSP, or other). In our approach, a PM comprises a set of performance indicators (PIs) organized hierarchically by cause-effect relationships [8]. Examples are given in section IV.…”