Cumulating the Intellectual Gold of Case Study Research

Abstract

Two criticisms of public administration research have been leveled. First, knowledge in the field is not being cumulated. Second, the research has low quality. A preference for case studies as a form of scientific inquiry is behind both criticisms. The authors propose a solution to the first problem by showing how meta-analysis can be used to cumulate knowledge using case study evidence. Viewed cumulatively, case studies comprise an intellectual goldmine awaiting discovery. The authors challenge the second criticism, proposing that quality judgments should be based on the important principle of knowledge cumulation, which acknowledges the value of all research methods.Evaluations of public administration research have permeated Public Administration Review for over a decade (Perry and Kraemer 1986;Stallings 1986;Stallings and Ferris 1988). Two themes pervade the literature criticizing research in the field: Critics contend that knowledge is not being cumulated (Adams and White 1994; White et al. 1996) and that research in general (dissertation research in particular) is of poor quality (Adams and White 1994;Cleary 1992;McCurdy and Cleary 1984;White 1986a;White et al. 1996). Criticisms that public administration research lacks quality remain largely unchallenged (see Bailey 1992 and Box 1992, for two rare exceptions).The use of case studies as a preferred research methodology in public administration lies behind both themes. Critics contend that case studies play a limited role in knowledge cumulation (Adams and White 1994) and that they fare poorly on indicators of quality (Adams and White 1994;McCurdy and Cleary 1984). Both claims can be traced to the perception that case studies are not generalizable, a perception we show to be terribly misconceived.We contend that public administration is well suited to case studies because they satisfy the recognized need for conditional findings and in-depth understanding of cause and effect relationships that other methodologies find difficult to achieve. Case studies are a key part of the solution, not part of the problem. We will show this by first defining case studies and by outlining a typology of case studies. Next, we will show how the knowledge-cumula-tion problem can be solved by using meta-analysis. Finally, we will explain how the criticism that case studies have poor quality is based on a problematic definition of quality and misguided criteria.The critics' test of quality generally involves counting the number of quality criteria that are satisfied in a study. The higher the count, the better the quality of the study. That is, the criteria are additive (see McCurdy and Cleary 1984). When a whole range of quality measures are applied to any single case study, it fares badly. Similarly, when a whole range of quality measures are applied to a study using a different methodology (survey research, for example), it is also likely to fare badly. The errors of this logic lie with the application of all quality criteria to each single, isolated study pertaining to a par...

Finding Ways to Effectively Use Year 12 Achievement Data to Inform Practice in Secondary Schools

“…The researchers' intention to include seven 'cases' was to allow better understanding, insight, and ability to theorise about a broader context (Berg, 2007). Since the intention of the study was to investigate current strategies used by school personnel to enhance student achievement, a singular snapshot (Jensen & Rodgers, 2001) collection of data was required. It was expected that the data gathered in this way would be more convincing than that which might emerge from a longitudinal examination.…”

Assessing Users' Perceptions on how to Improve Public Services Quality

“…This procedure does not conflict with the case-study methodology, which allows the use of qualitative and quantitative methods (Amaratunga and Baldry, 2001;Jensen and Rodgers, 2001). Indeed, data diversity may be considered one of the main contributions of this research, since triangulation strengthens constructs and hypotheses (Eisenhardt, 1989).…”

The Management of Long-Term Sickness Absence in Large Public Sector Healthcare Organisations: A Realist Evaluation Using Mixed Methods

“…Case studies evaluate both processes and outcomes. They not only describe what is happening but also attempt to explain why it is happening [31,32]. Case study evaluation incorporates the unintended consequences of particular interventions, which contribute to understanding why processes are working in some circumstances but not in others [33,34].…”