Identifying optimal frameworks to implement or evaluate digital health interventions: a scoping review protocol

Soobiah, Charlene; Cooper, Madeline; Kishimoto, Vanessa; Bhatia, R Sacha; Scott, Ted; Maloney, Shelagh; Larsen, Darren; Wijeysundera, Harindra C.; Zelmer, Jennifer; Gray, Carolyn Steele; Desveaux, Laura

doi:10.1136/bmjopen-2020-037643

Cited by 41 publications

(30 citation statements)

References 16 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, this may limit definitive conclusions if results present a high risk of bias or are not applicable outside their local context, limiting the wider clinical relevance. Second, there is currently no ‘gold-standard’ framework to evaluate the implementation of DHIs, 27 likely leading to heterogenous measures reported. In order to facilitate meaningful comparison between studies, the WHO evaluation framework for monitoring and evaluating DHIs 20 has been used as the basis for this review due to its applicability across different income settings and healthcare contexts.…”

Section: Discussionmentioning

confidence: 99%

Development stage of novel digital health interventions for postoperative monitoring: protocol of a systematic review

McLean

Knight

Diehl

et al. 2022

BMJ Surg Interv Health Technologies

View full text Add to dashboard Cite

IntroductionThe postoperative period represents a time where patients are at a high-risk of morbidity, which warrants effective surveillance. While digital health interventions (DHIs) for postoperative monitoring are promising, a coordinated, standardized and evidence-based approach regarding their implementation and evaluation is currently lacking. This study aimed to identify DHIs implemented and evaluated in postoperative care to highlight research gaps and assess the readiness for routine implementation.MethodsA systematic review will be conducted in accordance with Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines to identify studies describing the implementation and evaluation of DHIs for postoperative monitoring published since 2000 (PROSPERO ID: CRD42021264289). This will encompass the Embase, Cumulative Index to Nursing and Allied Health Literature, Cochrane Library, Web of Science and ClinicalTrials.gov databases, and manual search of bibliographies for relevant studies and gray literature. Methodological reporting quality will be evaluated using the Idea, Development, Exploration, Assessment and Long-term Follow-up (IDEAL) reporting guideline relevant to the IDEAL stage of the study, and risk of bias will be assessed using the Grading of Recommendations, Assessment, Development and Evaluations (GRADE) framework. Data will be extracted according to the WHO framework for monitoring and evaluating DHIs, and a narrative synthesis will be performed.DiscussionThis review will assess the readiness for implementation of DHIs for routine postoperative monitoring and will include studies describing best practice from service changes already being piloted out of necessity during the COVID-19 pandemic. This will identify interventions with sufficient evidence to progress to the next IDEAL stage, and promote standardized and comprehensive evaluation of future implementational studies.

show abstract

Section: Discussionmentioning

confidence: 99%

Development stage of novel digital health interventions for postoperative monitoring: protocol of a systematic review

McLean

Knight

Diehl

et al. 2022

BMJ Surg Interv Health Technologies

View full text Add to dashboard Cite

show abstract

“…DHIs can be defined as "health services delivered electronically through formal or informal care. DHIs can range from electronic medical records used by providers to mobile health (mHealth) apps used by consumers" [2]. The World Health Organization has recently produced a classification of DHIs, identifying four main types: clients, health care providers, health systems, and data services [3].…”

Section: Digital Health Interventionsmentioning

confidence: 99%

Application of the eHealth Literacy Model in Digital Health Interventions: Scoping Review

Benny¹,

Kabakian‐Khasholian²,

El‐Jardali³

et al. 2021

J Med Internet Res

View full text Add to dashboard Cite

Background Digital health interventions (DHIs) are increasingly being adopted globally to address various public health issues. DHIs can be categorized according to four main types of technology: mobile based, web based, telehealth, and electronic health records. In 2006, Norman and Skinner introduced the eHealth literacy model, encompassing six domains of skills and abilities (basic, health, information, scientific, media, and computer) needed to effectively understand, process, and act on health-related information. Little is known about whether these domains are assessed or accounted for in DHIs. Objective This study aims to explore how DHIs assess and evaluate the eHealth literacy model, describe which health conditions are addressed, and which technologies are used. Methods We conducted a scoping review of the literature on DHIs, based on randomized controlled trial design and reporting the assessment of any domain of the eHealth literacy model. MEDLINE, CINAHL, Embase, and Cochrane Library were searched. A duplicate selection and data extraction process was performed; we charted the results according to the country of origin, health condition, technology used, and eHealth literacy domain. Results We identified 131 unique DHIs conducted in 26 different countries between 2001 and 2020. Most DHIs were conducted in English-speaking countries (n=81, 61.8%), delivered via the web (n=68, 51.9%), and addressed issues related to noncommunicable diseases (n=57, 43.5%) or mental health (n=26, 19.8%). None of the interventions assessed all six domains of the eHealth literacy model. Most studies focused on the domain of health literacy (n=96, 73.2%), followed by digital (n=19, 14.5%), basic and media (n=4, 3%), and information and scientific literacy (n=1, 0.7%). Of the 131 studies, 7 (5.3%) studies covered both health and digital literacy. Conclusions Although many selected DHIs assessed health or digital literacy, no studies comprehensively evaluated all domains of the eHealth literacy model; this evidence might be overlooking important factors that can mediate or moderate the effects of these interventions. Future DHIs should comprehensively assess the eHealth literacy model while developing or evaluating interventions to understand how and why interventions can be effective.

show abstract

“…A recent scoping review of KT highlighted a range of theories, models and frameworks but reported that there was still little evidence of use in practice [ 26 ]. How frameworks can be utilised within the digital health context is also an area of interest [ 27 ] as is the need to engage with end-users to develop actionable plans and outcomes [ 28 ]. Huzair et al [ 29 ] argue that KT is not just about recognising that stakeholders have “a diverse set of understandings, values and goals, but are influenced by their socio-political and economic environment.” They recommend using a range of inter-disciplinary research methods and approaches to understand better the environment in which knowledge is intended to be used, including undertaking interviews with, and observing a wide range of relevant stakeholders.…”

Section: Developing An Engagement Frameworkmentioning

confidence: 99%

Benefits of Structured Engagement with Target Audiences of a Health Website: Study Design for a Multi-Case Study

Tieman

Lewis

2021

Healthcare

View full text Add to dashboard Cite

Access to evidence and practice knowledge precedes use, but availability does not guarantee reach and uptake by intended audiences. The CareSearch project provides online palliative care evidence and information to support health and aged care professionals as well as patients, carers and families to make informed decisions about care at the end of life. Already established in the palliative care sector, CareSearch commenced planning to extend its reach, and ensure website use is maximised for different audiences. This paper reports on the development of the Engagement Framework which will be used to guide and deliver an Engagement Project which will actively seek feedback and insights from intended users in a structured process. The process for developing the Engagement Framework commenced with a literature review of approaches used in knowledge translation, implementation science, and social marketing. The Engagement Framework comprising eight steps was then developed. The Engagement Framework outlines the series of tasks to be undertaken by team members when working with three target groups (Aged Care; Allied Health; and Patients, Carers and Families). A process/formative evaluation collecting data using qualitative methods is also described for use in the subsequent Engagement Project. The evaluation will explore the experiences of project participants as well as staff implementing the engagement activities. The three target groups will enable a cross-case comparison of the strengths and weaknesses of the approach. Planning, implementing and evaluating engagement with intended audiences, offers one mechanism to identify ways to increase interaction and integration with knowledge users.

show abstract

Identifying optimal frameworks to implement or evaluate digital health interventions: a scoping review protocol

Cited by 41 publications

References 16 publications

Development stage of novel digital health interventions for postoperative monitoring: protocol of a systematic review

Development stage of novel digital health interventions for postoperative monitoring: protocol of a systematic review

Application of the eHealth Literacy Model in Digital Health Interventions: Scoping Review

Benefits of Structured Engagement with Target Audiences of a Health Website: Study Design for a Multi-Case Study

Contact Info

Product

Resources

About