A comparative analysis of the assessment results of the competence of technical experts by different methods

A comparative analysis of the assessment results of the competence of technical experts by methods of analytic hierarchy process and with using the Rasch model

“…To assess the experts, there are a number of characteristics that are used to select both specific experts and expert groups: the coefficient of competence (CC), the coefficient of concordance, the coefficient of reliability of expert assessments, etc. A detailed analysis of the most commonly used expert methods, advantages and disadvantages of each has been presented in [1][2][3][4][5].…”

“…For research of complex objects or systems, the method of analytical hierarchy (Analytic Hierarchy Process, АНР) has been selected [6][7][8]. This method is a mathematical instrument of the systems approach to complex problems of decision-making, allows in the interactive mode to find such variant (alternative) that best comports both with its understanding of the problem and with requirements in relation to its solution [3,4]. Although, the base method of АНР [6][7][8] and its modifications [9][10][11][12] are applicable only in case of a small number of the set of alternatives and do not give an opportunity to combine different opinions of groups of experts.…”

“…To this end, a comparative analysis of the assessment of the suitability of the methods is used. The choice of the most optimal method for group expert evaluation and a comparative analysis of suitability for application to increase the efficiency of complex systems were the subject of previous studies by the authors [1][2][3][4][5].…”

A comparative analysis of results of the group expert assessment of metrological assurance of measurements

“…A thorough analysis of the appropriate methods for the competence assessment of experts in standardization and metrological assurance (MA) was the subject of previous studies [1,2]. The most common expert methods are quite simple and have the imperfections:…”

“…Since these methods are based on various algorithms for the implementation of expert evaluation, the chosen method needs to be improved to meet certain needs in a particular field [1]. Exactly the same methods were applied by the authors during the realization of research on increasing the efficiency of complex systems and competence evaluation of experts in the sphere of technical regulation [1,2]. The urgency of the work is confirmed by the growing dissemination of expert methods for solving problems and making decisions for complex organizational and technical systems.…”