Are Validity and Reliability "Relevant" in Qualitative Evaluation Research?

Abstract

Interest in and use of qualitative methodological strategies in evaluating research have increased considerably in the last few years. Many of the recent evaluation frameworks or models are entirely or partly oriented toward use of qualitative methods. A number of methodological issues and concerns have been raised, including the appropriateness of validity and reliability estimation for the measurement strategies employed in qualitative evaluations becoming more common in health and other fields. In this article, the views of prominent qualitative methodologists on this topic are briefly summarized; a case is made for the relevance of validity and reliability estimation; definitions of validity and reliability for qualitative measurement are presented; and appropriate estimation techniques are suggested. It is hoped that discussions such as this will promote increased attention to validity and reliability concerns in qualitative evaluations and thus help improve the quality of those evaluations.

Examining the Attitudes and Intention to Use Synchronous Distance Learning Technology among Pre-service Teachers: A Qualitative Perspective of Technology Acceptance Model

“…This feedback process is called as "member checking" [52]. In this study, amount of agreement (within the collected data) between independent data coders were used to calculate interrecorder or interanalyst reliability [71]. A second coder, a specialist in qualitative research studies as well as in the field, first got familiar with the coding scheme by practicing the coding process on the same texts that the other coder worked on.…”

Barriers to good sickness certification — an interview study with Swedish general practitioners

“…All interviews were performed between November 2003 and July 2004 by the first author (MS), to avoid inter-interviewer reliability problems [17]. A semi-structured interview guide with open questions was used, designed to focus on the GP's own experience of sickness certification and to obtain descriptions of concrete situations (Table I).…”

The Impact of a Parenting Guidance Programme for Mothers with an Ethnic Minority Background

“…Material was translated into Urdu by certified translators, and back translated for accuracy. Semi-structured debrief interviews were conducted with a sub-sample (Goodwin & Goodwin 1984) to explore personal relevance and importance of the topics, usefulness of the programme, and suggestions for improvements.…”