Framework for multi-criteria assessment of classification models for the purposes of credit scoring

Abstract

The main dilemma in the case of classification tasks is to find—from among many combinations of methods, techniques and values of their parameters—such a structure of the classifier model that could achieve the best accuracy and efficiency. The aim of the article is to develop and practically verify a framework for multi-criteria evaluation of classification models for the purposes of credit scoring. The framework is based on the Multi-Criteria Decision Making (MCDM) method called PROSA (PROMETHEE for Sustainability Analysis), which brought added value to the modelling process, allowing the assessment of classifiers to include the consistency of the results obtained on the training set and the validation set, and the consistency of the classification results obtained for the data acquired in different time periods. The study considered two aggregation scenarios of TSC (Time periods, Sub-criteria, Criteria) and SCT (Sub-criteria, Criteria, Time periods), in which very similar results were obtained for the evaluation of classification models. The leading positions in the ranking were taken by borrower classification models using logistic regression and a small number of predictive variables. The obtained rankings were compared to the assessments of the expert team, which turned out to be very similar.

Selection of Photovoltaic Panels Based on Ranges of Criteria Weights and Balanced Assessment Criteria

“…Then, in the l-th iteration of Monte Carlo, the PROSA procedure is used, which determines the ranking of alternatives (PV panels) [57]. For each criterion, the preference function F j is used, and based on the difference between the alternatives, the preference P j , between the tested pair of alternatives (a, b), is determined according to Formula (3):…”

Temporal Analysis of Energy Transformation in EU Countries

“…The PROSA method can be used here, which allows you to consider the balance between elements of the same type in the decision-making model in the final assessment. These elements may be decision criteria (in the PROSA-C method) [44,45], groups of criteria (in the PROSA g method) [22], the results of individual assessment obtained by individual DMs (in the PROSA GDSS method) [46,47] or all these elements at the same time [48]. In the proposed modification of the DMCDM/TMCDM framework, these elements are temporal results (rankings) of alternatives obtained for a given period.…”