different proportions of high risk pregnancies and parity, but using standard populations of primiparous women at low risk identified by the criteria described here could enable valid international comparisons of spontaneous preterm delivery rates to be made.Contributors: JL-R conceived the study in collaboration with UK. SR retrieved register data and performed the initial analyses. UK performed additional statistical analyses. All authors contributed to the data interpretation. JL-R wrote the first draft of the manuscript and all authors contributed to the revision. AbstractObjectives To determine the prevalence of false or misleading statements in messages posted by internet cancer support groups and whether these statements were identified as false or misleading and corrected by other participants in subsequent postings.

BackgroundDelayed diagnosis of cancer can lead to patient harm, and strategies are needed to proactively and efficiently detect such delays in care. We aimed to develop and evaluate ‘trigger’ algorithms to electronically flag medical records of patients with potential delays in prostate and colorectal cancer (CRC) diagnosis.MethodsWe mined retrospective data from two large integrated health systems with comprehensive electronic health records (EHR) to iteratively develop triggers. Data mining algorithms identified all patient records with specific demographics and a lack of appropriate and timely follow-up actions on four diagnostic clues that were newly documented in the EHR: abnormal prostate-specific antigen (PSA), positive faecal occult blood test (FOBT), iron-deficiency anaemia (IDA), and haematochezia. Triggers subsequently excluded patients not needing follow-up (eg, terminal illness) or who had already received appropriate and timely care. Each of the four final triggers was applied to a test cohort, and chart reviews of randomly selected records identified by the triggers were used to calculate positive predictive values (PPV).ResultsThe PSA trigger was applied to records of 292 587 patients seen between 1 January 2009 and 31 December 2009, and the CRC triggers were applied to 291 773 patients seen between 1 March 2009 and 28 February 2010. Overall, 1564 trigger positive patients were identified (426 PSA, 355 FOBT, 610 IDA and 173 haematochezia). Record reviews revealed PPVs of 70.2%, 66.7%, 67.5%, and 58.3% for the PSA, FOBT, IDA and haematochezia triggers, respectively. Use of all four triggers at the study sites could detect an estimated 1048 instances of delayed or missed follow-up of abnormal findings annually and 47 high-grade cancers.ConclusionsEHR-based triggers can be used successfully to flag patient records lacking follow-up of abnormal clinical findings suspicious for cancer.

BackgroundSuccessful subspecialty referrals require considerable coordination and interactive communication among the primary care provider (PCP), the subspecialist, and the patient, which may be challenging in the outpatient setting. Even when referrals are facilitated by electronic health records (EHRs) (i.e., e-referrals), lapses in patient follow-up might occur. Although compelling reasons exist why referral coordination should be improved, little is known about which elements of the complex referral coordination process should be targeted for improvement. Using Okhuysen & Bechky's coordination framework, this paper aims to understand the barriers, facilitators, and suggestions for improving communication and coordination of EHR-based referrals in an integrated healthcare system.MethodsWe conducted a qualitative study to understand coordination breakdowns related to e-referrals in an integrated healthcare system and examined work-system factors that affect the timely receipt of subspecialty care. We conducted interviews with seven subject matter experts and six focus groups with a total of 30 PCPs and subspecialists at two tertiary care Department of Veterans Affairs (VA) medical centers. Using techniques from grounded theory and content analysis, we identified organizational themes that affected the referral process.ResultsFour themes emerged: lack of an institutional referral policy, lack of standardization in certain referral procedures, ambiguity in roles and responsibilities, and inadequate resources to adapt and respond to referral requests effectively. Marked differences in PCPs' and subspecialists' communication styles and individual mental models of the referral processes likely precluded the development of a shared mental model to facilitate coordination and successful referral completion. Notably, very few barriers related to the EHR were reported.ConclusionsDespite facilitating information transfer between PCPs and subspecialists, e-referrals remain prone to coordination breakdowns. Clear referral policies, well-defined roles and responsibilities for key personnel, standardized procedures and communication protocols, and adequate human resources must be in place before implementing an EHR to facilitate referrals.

OBJECTIVES: Electronic health records (EHR) enable transmission and tracking of referrals between primarycare practitioners (PCPs) and subspecialists. We used an EHR to examine follow-up actions on electronic referral communication in a large multispecialty VA facility. METHODS: We retrieved outpatient referrals to five subspecialties between October 2006 and December 2007, and queried the EHR to determine their status: completed, discontinued (returned to PCP), or unresolved (no action taken by subspecialist). All unresolved referrals, and random samples of discontinued and completed referrals were reviewed to determine whether subspecialists took follow-up actions (i.e., schedule appointments anytime in the future) within 30 days of referral-receipt. For referrals without timely follow-up, we determined whether inaction was supported by any predetermined justifiable reasons or associated with certain referral characteristics. We also reviewed if PCPs took the required action on returned information. RESULTS: Of 61,931 referrals, 22,535 were discontinued (36.4%), and 474 were unresolved (0.8%). We selected 412 discontinued referrals randomly for review. Of these, 52% lacked follow-up actions within 30 days. Appropriate justifications for inaction were documented in 69.8% (150/215) of those without action and included lack of prerequisite testing by the PCP and subspecialist opinion that no intervention was required despite referral. We estimated that at 30 days, 6.3% of all referrals were associated with an unexplained lack of follow-up actions by subspecialists. Conversely, 7.4% of discontinued referrals returned to PCPs were associated with an unexplained lack of follow-up. CONCLUSIONS: Although the EHR facilitates transmission of valuable information at the PCP-subspecialist interface, unexplained communication breakdowns in the referral process persist in a subset of cases.

BackgroundNotifying clinicians about abnormal test results through electronic health record (EHR) -based "alert" notifications may not always lead to timely follow-up of patients. We sought to understand barriers, facilitators, and potential interventions for safe and effective management of abnormal test result delivery via electronic alerts.MethodsWe conducted a qualitative study consisting of six 6-8 member focus groups (N = 44) at two large, geographically dispersed Veterans Affairs facilities. Participants included full-time primary care providers, and personnel representing diagnostic services (radiology, laboratory) and information technology. We asked participants to discuss barriers, facilitators, and suggestions for improving timely management and follow-up of abnormal test result notifications and encouraged them to consider technological issues, as well as broader, human-factor-related aspects of EHR use such as organizational, personnel, and workflow.ResultsProviders reported receiving a large number of alerts containing information unrelated to abnormal test results, many of which were believed to be unnecessary. Some providers also reported lacking proficiency in use of certain EHR features that would enable them to manage alerts more efficiently. Suggestions for improvement included improving display and tracking processes for critical alerts in the EHR, redesigning clinical workflow, and streamlining policies and procedures related to test result notification.ConclusionProviders perceive several challenges for fail-safe electronic communication and tracking of abnormal test results. A multi-dimensional approach that addresses technology as well as the many non-technological factors we elicited is essential to design interventions to reduce missed test results in EHRs.

Electronic health records are increasingly being used to facilitate referral communication in the outpatient setting. However, despite support by technology, referral communication between primary care providers and specialists is often unsatisfactory and is unable to eliminate care delays. This may be in part due to lack of attention to how information and communication technology fits within the social environment of health care. Making electronic referral communication effective requires a multifaceted “socio-technical” approach. Using an 8-dimensional socio-technical model for health information technology as a framework, we describe ten recommendations that represent good clinical practices to design, develop, implement, improve, and monitor electronic referral communication in the outpatient setting. These recommendations were developed on the basis of our previous work, current literature, sound clinical practice, and a systems-based approach to understanding and implementing health information technology solutions. Recommendations are relevant to system designers, practicing clinicians, and other stakeholders considering use of electronic health records to support referral communication.

PURPOSE.To assess agreement between monoscopic and stereoscopic photography for research classification of the severity of diabetic retinopathy (DR). METHODS. Monoscopic digital (MD) images were compared with stereo digital (SD) and film (SF) photographs from a 152-eye cohort with full-spectrum Early Treatment Diabetic Retinopathy Study (ETDRS) severity levels for agreement on severity level, DR presence with ascending severity threshold, presence of DR index lesions, and repeatability of grading. RESULTS. There was substantial agreement classifying ETDRS DR severity levels between MD and SF ( ϭ 0.65, w [linear weighted] ϭ 0.87), MD and SD ( ϭ 0.66, w ϭ 0.87), and SD and SF ( ϭ 0.62, w ϭ 0.86) images. Marginal homogeneity analyses found no significant difference between MD and SF images (P ϭ 0.53, Bhapkar test). The agreement between MD and SF ranged from 0.80 to 0.94 for the presence or absence of eight ascending DR severity thresholds. Repeatability between the readers of the MD images was equal to or better than that of the readers of SD or SF images. Severity threshold grading repeatability between readers was similar with the MD and SF images. The agreement between MD and SF for identifying diabetic retinopathy lesions ranged from moderate to almost perfect. The comparisons showed that performance of grading new vessels on the disc in MD images was slightly lower than that with the SF images. CONCLUSIONS. Monoscopic photography can equal the reliability of stereo photography for full ETDRS DR severity scale grading. (Invest Ophthalmol Vis Sci.

To address the factors involved in missed test results, we developed a software prototype to account for technical, usability, organizational, and workflow needs. Our evaluation has shown the feasibility of the prototype as a means of facilitating better follow-up for cancer-related abnormal test results.