The Delphi Method for Graduate Research

Abstract

Executive SummaryThe Delphi method is an attractive method for graduate students completing masters and PhD level research. It is a flexible research technique that has been successfully used in our program at the University of Calgary to explore new concepts within and outside of the information systems body of knowledge. The Delphi method is an iterative process to collect and distill the anonymous judgments of experts using a series of data collection and analysis techniques interspersed with feedback. The Delphi method is well suited as a research instrument when there is incomplete knowledge about a problem or phenomenon; however it is not a method for all types of IS research questions. The Delphi method works especially well when the goal is to improve our understanding of problems, opportunities, solutions, or to develop forecasts. In this paper, we provide a brief background of the Classical Delphi followed by a presentation of how it has evolved into a flexible research method appropriate for a wide variety of IS research projects, such as determining the criteria for IS prototyping decisions, ranking technology management issues in new product development projects, and developing a descriptive framework of knowledge manipulation activities. To illustrate the method's flexibility, we summarize distinctive non-IS, IS, and graduate studies Delphi research projects. We end by discussing what we have learned from using the Delphi method in our own research regarding this method's design factors and how it may be applied to those conducting graduate studies research: i) methodological choices such as a qualitative, quantitative or mixed methods approach; ii) initial question degree of focus whether it be broad or narrowly focused; iii) expertise criteria such as technical knowledge and experience, capacity and willingness to participate, sufficient time, and communication skills; vi) number of participants in the heterogeneous or homogeneous sample, v) number of Delphi rounds varying from one to 6, vi) mode of interaction such as through email, online surveys or groupware, vii) methodological rigor and a research audit trail, viii) results analysis, ix) further verification through triangulation or with another sample, and x) publishing of the results. We include an extensive bibliography and an appendix with a wide-ranging list of dissertations that have used the Delphi method (including brief research description, number of rounds and sample size). The Delphi method is a flexible, effective and efficient research method that can be successful used by IS graduate students to answer research questions in information systems and to rigorously advance the IS body of knowledge.

Questionário De Prontidão Para O Esporte Com Foco Nas Lesões Musculoesqueléticas

“…De posse das avaliações, o experimentador pode fazer alterações no questionário, acatando (ou não) as sugestões propostas, levando em consideração o conhecimento, a experiência e a criatividade do painel de especialistas com notório saber na temática em questão 3,16,18,19 .…”

Análise Prospectiva da Indústria Bancária no Brasil: Regulação, Concentração e Tecnologia

“…Embora haja críticas quanto à confiabilidade e à validade do Delphi enquanto método científico, visto que a etapa de amostragem dos respondentes e a análise dos resultados não obedecem ao rigor estatístico, há evidências de que este método seja utilizado com frequência em pesquisas acadêmicas em diversos contextos (Landeta, 2006;Rieger, 1986;Skulmoski, Hartman, & Krahn, 2007). Tal fato denota a aceitação do Delphi pela comunidade científica como uma técnica metodológica, pois não só impõe menos restrições aos respondentes quanto à formulação de sua realidade, mas também proporciona a obtenção de dados e informações relevantes na ausência de dados sistematizados que possam subsidiar a pesquisa.…”

Avaliação de mestrados profissionais: construção e análise de indicadores à luz da multidimensionalidade

“…O processo iterativo permite coletar e destilar julgamentos anônimos, usando técnicas de coleta e feedback. A técnica permite incrementar o entendimento acerca de problemas, oportunidades ou previsões de futuro (SKULMOSKI; HARTMAN; KRAHN, 2007).…”