How Good Are Your Types? Using Mutation Analysis to Evaluate the Effectiveness of Type Annotations

Coevolution of Second-order-mutant

“…Mutation testing mainly used to mutate source code or programming language feature [9], but mutation testing is also capable in testing software design [10], to mutate software model [11], [12], or even used as a tool for teaching software testing [13]. The research about mutation testing has been developed to expand its practice to a more complex application [14] [15] or specific platform (i.e Android [16], [17] and web application [18]).…”

“…As shown in Table 5 and Table 6, it is proved that there is a relation between the redundancy level with the coevolution performance. In the Find case has the lowest test case redundancy level ( Table 6, Find case column [4][5][6][7][8][9][10][11][12], and it also has a good performance in test case growth ( Table 5, Find case column 2-4). The relation also shows in mutant solution, the high level of mutant redundancy in BubbleSort, Find and HSL Color (Table 6, column 1-3), correlated with the decrease in mutant growth ( Table 5, column 1), while low redundancy level redundancy in Mid case, related with improved growth.…”