(I Can’t Get No) Saturation: A Simulation and Guidelines for Sample Sizes in Qualitative Research

Abstract

I explore the sample size in qualitative research that is required to reach theoretical saturation. I conceptualize a population as consisting of sub-populations that contain different types of information sources that hold a number of codes. Theoretical saturation is reached after all the codes in the population have been observed once in the sample. I delineate three different scenarios to sample information sources: "random chance," which is based on probability sampling, "minimal information," which yields at least one new code per sampling step, and "maximum information," which yields the largest number of new codes per sampling step. Next, I use simulations to assess the minimum sample size for each scenario for systematically varying hypothetical populations. I show that theoretical saturation is more dependent on the mean probability of observing codes than on the number of codes in a population. Moreover, the minimal and maximal information scenarios are significantly more efficient than random chance, but yield fewer repetitions per code to validate the findings. I formulate guidelines for purposive sampling and recommend that researchers follow a minimum information scenario.

Understanding the patient perspective of epilepsy treatment through text mining of online patient support groups

“…We also considered other websites, such as patientslikeme.com and myepilepsyteam.com in the initial study design, but did not include them in final experiments, primarily because of their different privacy policies, where users are required to register with complete or partial disclosure of their identity. However, such a large sample size is still statistically sufficient to provide reliable results [22].…”

The Cardiac Care Bridge randomized trial in high‐risk older cardiac patients: A mixed‐methods process evaluation

“…Main themes were formed from matching codes by LV and DS, to reflect the data. Interviews were stopped when theoretical saturation was reached and no new codes and themes were formed (van Rijnsoever, 2017; Vasileiou et al., 2018). MAX‐QDA 12 Standard (Berlin, Germany) was used in the analysis.…”

Informing a priori Sample Size Estimation in Qualitative Concept Elicitation Interview Studies for Clinical Outcome Assessment Instrument Development

“…For example, Tran et al [14] proposed a data-driven methodology for predicting saturation in qualitative research using mathematical models from ecological research; however, this approach was specifically designed for use in surveys with open-ended questions. Van Rijnsoever [15] used data simulations to predict minimum sample size for qualitative research, taking into account purposive sampling methods and different sampling scenarios. However, as noted by the author, applications of results from this study are limited in that the scenarios may not represent real-world sampling procedures.…”