Searching for rigour in the reporting of mixed methods population health research: a methodological review

Abstract

The environments in which population health interventions occur shape both their implementation and outcomes. Hence, when evaluating these interventions, we must explore both intervention content and context. Mixed methods (integrating quantitative and qualitative methods) provide this opportunity. However, although criteria exist for establishing rigour in quantitative and qualitative research, there is poor consensus regarding rigour in mixed methods. Using the empirical example of school-based obesity interventions, this methodological review examined how mixed methods have been used and reported, and how rigour has been addressed. Twenty-three peer-reviewed mixed methods studies were identified through a systematic search of five databases and appraised using the guidelines for Good Reporting of a Mixed Methods Study. In general, more detailed description of data collection and analysis, integration, inferences and justifying the use of mixed methods is needed. Additionally, improved reporting of methodological rigour is required. This review calls for increased discussion of practical techniques for establishing rigour in mixed methods research, beyond those for quantitative and qualitative criteria individually. A guide for reporting mixed methods research in population health should be developed to improve the reporting quality of mixed methods studies. Through improved reporting, mixed methods can provide strong evidence to inform policy and practice.

A Methodological Review of Mixed Methods Research in Palliative and End-of-Life Care (2014–2019)

“…A key finding of this review is that the reporting of the mixed methods articles published in the eight journals examined showed a need for improvement. In line with previous reviews [8,35], none of the articles included in our review fulfilled all six GRAMMS criteria and none of the six criteria was fulfilled by all the articles. The reporting quality was not consistent across the six criteria, with variations according to the particular mixed methods feature being examined.…”

“…Palliative care and other health researchers face important challenges when reporting mixed methods research. These include the length limitations of journals [26], practitioners' lack of familiarity with mixed methods research [4], the complexity of reporting integration [21], and authors' lack of knowledge of reporting guidelines [35].…”

Breastfeeding practices 2008–2009 among Chinese mothers living in Ireland: a mixed methods study

“…The quantitative results illustrated the prevalence and determinants of breastfeeding initiation and duration, and the qualitative results provided an in-depth explanation of the phenomenon and barriers to breastfeeding. Both results were integrated in the discussion, and shared equal priority [38,46].…”

“…Content analysis was performed to explain and elaborate on the quantitative findings. Both quantitative and qualitative results were finally integrated when drawing the conclusions [38].…”

Expressed Needs of Students for Prevention of Internet Addiction: A Content Analysis Study

“…Furthermore, findings were returned to the participants for members check. The reliability of the findings was ensured by early prescription, precise recording of the work procedures, mixed data collection methods, and mixed time as well as place (24,25). NVivo version 9 was used to store, manage, and analyze the data.…”