The Science of Learning Health Systems: Scoping Review of Empirical Research

Abstract

Background The development and adoption of a learning health system (LHS) has been proposed as a means to address key challenges facing current and future health care systems. The first review of the LHS literature was conducted 5 years ago, identifying only a small number of published papers that had empirically examined the implementation or testing of an LHS. It is timely to look more closely at the published empirical research and to ask the question, Where are we now? 5 years on from that early LHS review. Objective This study performed a scoping review of empirical research within the LHS domain. Taking an “implementation science” lens, the review aims to map out the empirical research that has been conducted to date, identify limitations, and identify future directions for the field. Methods Two academic databases (PubMed and Scopus) were searched using the terms “learning health* system*” for papers published between January 1, 2016, to January 31, 2021, that had an explicit empirical focus on LHSs. Study information was extracted relevant to the review objective, including each study’s publication details; primary concern or focus; context; design; data type; implementation framework, model, or theory used; and implementation determinants or outcomes examined. Results A total of 76 studies were included in this review. Over two-thirds of the studies were concerned with implementing a particular program, system, or platform (53/76, 69.7%) designed to contribute to achieving an LHS. Most of these studies focused on a particular clinical context or patient population (37/53, 69.8%), with far fewer studies focusing on whole hospital systems (4/53, 7.5%) or on other broad health care systems encompassing multiple facilities (12/53, 22.6%). Over two-thirds of the program-specific studies utilized quantitative methods (37/53, 69.8%), with a smaller number utilizing qualitative methods (10/53, 18.9%) or mixed-methods designs (6/53, 11.3%). The remaining 23 studies were classified into 1 of 3 key areas: ethics, policies, and governance (10/76, 13.2%); stakeholder perspectives of LHSs (5/76, 6.6%); or LHS-specific research strategies and tools (8/76, 10.5%). Overall, relatively few studies were identified that incorporated an implementation science framework. Conclusions Although there has been considerable growth in empirical applications of LHSs within the past 5 years, paralleling the recent emergence of LHS-specific research strategies and tools, there are few high-quality studies. Comprehensive reporting of implementation and evaluation efforts is an important step to moving the LHS field forward. In particular, the routine use of implementation determinant and outcome frameworks will improve the assessment and reporting of barriers, enablers, and implementation outcomes in this field and will enable comparison and identification of trends across studies.

Identifying requisite learning health system competencies: a scoping review

“… 1 The LHS concept has spread globally, with publications focusing on process models, micro to meso to macro system levels of analysis, infrastructure requirements to achieve such systems, the values underlying the cultural shift required to achieve such systems and case studies exploring the application of the concept within healthcare. 2 3 However, there is a paucity of evidence indicating the effectiveness of LHS across levels of analysis. Moreover, there is a need for increased understanding of the requisite competencies and capabilities across levels of a system that promote learning and continuous quality improvement.…”

The journey to a Learning Health System in primary care: a qualitative case study utilising an embedded research approach

“…Science, informatics and technology are often the most discussed element of LHSs throughout the literature (8,18,19). Some clear challenges exist to the utility of technology and data as a tool for QI within MQGP.…”

“…The majority of literature discussing LHSs remains theoretical or normative in nature(18, 19), with an identi ed need for further empirical work speci c to primary care(8). Thus, the objective of this paper is to present an empirical case study of an LHS in primary care.…”

A conceptual framework to describe and evaluate a socially accountable learning health system: Development and application in a northern, rural, and remote setting

“…To date, there is little empirical evidence that a learning health system model contributes to the benefits that are expected, particularly at a system level with the complexity of multiple organisations and actors. 38 Importantly, this framework and our specific application intentionally address this gap by illustrating how we might describe and test these assumptions.…”