A comparative analysis of R&D project evaluation methods

Abstract

A large number of methodologies for Research and Development (R&D) project evaluation have been developed and reported in the literature over the last few decades. Almost all of this literature focused on the mechanisms and underlying theoretical foundation on which the evaluation methods are based. Very little attention has been paid to the effectiveness and suitability of the techniques, especially a comparison of the techniques. This paper presents a comparative study on a number of classes of R&D evaluation methods based on the Analytic Hierarchy Process. We look into the various factors and characteristics of R&D evaluation methods that affect their suitability. A sensitivity analysis was also carried out to determine the critical factors.

Identification of Prospective Collaboration Networks in International R&D Programmes

“…При подготовке государственных исследователь-ских программ ключевой задачей, требующей адекват-ного методологического обеспечения, является расста-новка тематических приоритетов [Poh et al, 2001;. Существуют различные способы определения приоритетов -от целенаправленного распределения портфелей [Stewart, 1991;Oral et al, 1991] до многоэтапных процессов с вовлечением широкого круга участников, где вначале разрабатывается общая программа исследований, а затем принимаются реше-ния о возможности финансирования представленных проектных предложений [Tian et al, 2005;Salo, Liesiö, 2006].…”

“…Основное преимущество подобных инструмен-тов -создание системы регулярного анализа будущих возможностей и ее использование в оценке потенци-альных исследовательских проектов, что обеспечива-ет открытость и последовательность формирования и реализации стратегии [Salo et al, 2003]. В литературе представлен ряд примеров применения многокритери-альных методов оценки для определения приоритетов научно-технологической политики; среди них: «анали-тический иерархический процесс» (Analytic Hierarchy Process, AHP) [Saaty, 1980;Poh et al, 2001], «включе-ние рядов в иерархии критериев» (Rank Inclusion in Criteria Hierarchies, RICH) [Salo, Punkka, 2005;Salo, Liesiö, 2006] и робастное портфельное моделирование (Robust Portfolio Modeling, RPM) [Liesiö et al, 2007Бруммер и др., 2010а, 2010б].…”

Optimal selection policies for a sequence of candidate drugs

“…Good review papers have been written by Miller [11] and Poh et al [12]. Bergman and Gittins [1] described the research and development resource allocation methods which at that time had been applied in the pharmaceutical industry.…”

An Investigation of Fast and Frugal Heuristics for New Product Project Selection

“…Analogy-based models are comparative models that use historical data to create statistical models that compare the current projects with data from previous projects to compute the probability of project success and the overall value of the project [83]. This method helps to predict project performance and helps companies to determine the market effort required to achieve similar results when the nature of the projects and the environment are similar [60].…”

“…Scoring models are multi criteria decision models that evaluate projects under different criteria, and use mathematical formulas or algebraic expressions to calculate the outcomes [72,83]. Scoring models can take the shape of an arrangement checklist criteria with weights of importance assigned to each criterion.…”