Impact of Research-based Synopses Delivered as Daily E-mail: A Prospective Observational Study

Abstract

We conducted a prospective observational study to (1) determine usage and construct validity of a method to gauge the cognitive impact of information derived from daily e-mail, and (2) describe self-reported impacts of research-based synopses (InfoPOEMs) delivered as e-mail. Ratings of InfoPOEMs using an Impact assessment scale provided (a) data on usage of the impact assessment method, (b) reports of impact by InfoPOEM and by doctor and (c) data for analysis of construct validity of the scale. PARTICIPANTS were family physicians or general practitioners who rated at least five InfoPOEMs delivered on e-mail. For each InfoPOEM rated, 0.1 continuing education credit was awarded by the College of Family Physicians of Canada. Use of the impact assessment scale linked to a daily InfoPOEM was sustained during the 150-day study period. 1,007 participants submitted 61,493 reports of 'cognitive impact' by rating on average 61 InfoPOEMs (range 5-111). 'I learned something new' was most frequently reported. 'I was frustrated as there was not enough information or nothing useful' was the most frequently reported negative type of impact. The proportion of reports of 'No Impact' varied substantially across individual InfoPOEMs. Impact patterns suggested an 8 or 9-factor solution. Our Impact assessment method facilitates knowledge transfer by promoting two-way exchange between providers of health information and family doctors. Providers of health information can use this method to better understand the impact of research-based synopses. Sustaining current practice and increasing knowledge about new developments in medicine are important outcomes arising from research-based synopses delivered as e-mail, in addition to practice change.

Randomized Controlled Trial of RSS Reader Use and Resident Familiarity With Primary Literature

“…20 It is not clear whether increased familiarity or knowledge of articles affects clinical care. For e-mail-based research summaries, the evidence is limited; e-mail alerts were associated with self-reported practice improvement in 1 study, 21 but had no effect on clinical practice in other studies. 22,23 Our study has several limitations.…”

Patient-Oriented Evidence that Matters (POEMs) Suggest Potential Clinical Topics for the Choosing Wisely Campaign

“…In the context of this program, physician members of the CMA earn a minicredit for reflecting on each POEM synopsis they read. 7 Mini-credits are awarded by the College of Family Physicians of Canada (0.1 Mainpro-M1), as well as the Royal College of Physicians and Surgeons of Canada (0.25 Maincert Section 2). Accreditation is based on meeting the objective of reflective learning and is documented by the completion of a brief questionnaire for each POEM that was read.…”

Knowledge Dissemination Interventions

“…A total of 8 KDIs were performed in health settings (Amsallem et al, 2007;Colantonio et al, 2008;Dobbins et al, 2009;Gross & Lowe, 2009;Hartling et al, 2010;Kirshbaum, 2008;Russell et al, 2010;Stiell et al, 2010), 5 in community settings (including theater spaces; Allender et al, 2011;Hundt et al, 2011;Redwood et al, 2010;Smith et al, 2011;Stuttaford et al, 2006), 3 in virtual locations, via the Internet (Ginsburg et al, 2007;Grad et al, 2008;Tanna et al, 2011), and 2 in universities or research centers (Kobus et al, 2007;Wilkinson et al, 2009). The location of one intervention was not specified in the article reporting on it (Mason, 2008).…”

“…The authors noted that only participants from Strategy 2 improved from baseline. Grad et al (2008) delivered a research-based synopsis to physicians by email and used a self-reported cognitive impact assessment method to evaluate the intervention. They concluded that synopses sent daily were effective for knowledge acquisition and changes in attitudes: "I learned something new" (Grad et al, 2002, p. 241) was the most frequently reported impact by research participants.…”