New Metrics to Measure the Quality of the Ranking Results Obtained by the Multi-criteria Decision-Making Methods

Abstract

Nowadays, there is a panoply of multi-criteria decision-making methods which are proposed in the literature to solve the ranking problematic, where each method has its resolution process and has its drawbacks and advantages. These methods aim to rank from best to worst a finite set of alternatives while taking into account a set of conflictual criteria. The purpose of this article is to propose specific metrics that will be useful to measure the quality of the rankings obtained by different methods. Thus, these quality measures can help the decision-maker to choose the best ranking objectively when adopting several methods. To show and prove the importance and relevance of the metrics proposed, a set of twenty-five examples of rankings will be examined. The results of the experiment conclusively show that all the proposed metrics lead to significant and equivalent quality measures.