BackgroundComputerised clinical decision support (CDS) can potentially better inform decisions, and it can help with the management of information overload. It is perceived to be a key component of a learning health care system. Despite its increasing implementation worldwide, it remains uncertain why the effect of CDS varies and which factors make CDS more effective.ObjectiveTo examine which factors make CDS strategies more effective on a number of outcomes, including adherence to recommended practice, patient outcome measures, economic measures, provider or patient satisfaction, and medical decision quality.MethodsWe identified randomised controlled trials, non-randomised trials, and controlled before-and-after studies that directly compared CDS implementation with a given factor to CDS without that factor by searching CENTRAL, MEDLINE, EMBASE, and CINAHL and checking reference lists of relevant studies. We considered CDS with any objective for any condition in any healthcare setting. We included CDS interventions that were either displayed on screen or provided on paper and that were directed at healthcare professionals or targeted at both professionals and patients. The reviewers screened the potentially relevant studies in duplicate. They extracted data and assessed risk of bias in independent pairs or individually followed by a double check by another reviewer. We summarised results using medians and interquartile ranges and rated our certainty in the evidence using the GRADE system.ResultsWe identified 66 head-to-head trials that we synthesised across 14 comparisons of CDS intervention factors. Providing CDS automatically versus on demand led to large improvements in adherence. Displaying CDS on-screen versus on paper led to moderate improvements and making CDS more versus less patient-specific improved adherence modestly. When CDS interventions were combined with professional-oriented strategies, combined with patient-oriented strategies, or combined with staff-oriented strategies, then adherence improved slightly. Providing CDS to patients slightly increased adherence versus CDS aimed at the healthcare provider only. Making CDS advice more explicit and requiring users to respond to the advice made little or no difference. The CDS intervention factors made little or no difference to patient outcomes. The results for economic outcomes and satisfaction outcomes were sparse.ConclusionMultiple factors may affect the success of CDS interventions. CDS may be more effective when the advice is provided automatically and displayed on-screen and when the suggestions are more patient-specific. CDS interventions combined with other strategies probably also improves adherence. Providing CDS directly to patients may also positively affect adherence. The certainty of the evidence was low to moderate for all factors.Trial registrationPROSPERO, CRD42016033738Electronic supplementary materialThe online version of this article (10.1186/s13012-018-0790-1) contains supplementary material, which is available to authorized users.

Healthcare organizations are confronted with challenges including the contention between tightening budgets and increased care needs. In the light of these challenges, they are becoming increasingly aware of the need to improve their processes to ensure quality of care for patients. To identify process improvement opportunities, a thorough process analysis is required, which can be based on real-life process execution data captured by health information systems. Process mining is a research field that focuses on the development of techniques to extract process-related insights from process execution data, providing valuable and previously unknown information to instigate evidence-based process improvement in healthcare. However, despite the potential of process mining, its uptake in healthcare organizations outside case studies in a research context is rather limited. This observation was the starting point for an international brainstorm seminar. Based on the seminar's outcomes and with the ambition to stimulate a more widespread use of process mining in healthcare, this paper formulates recommendations to enhance the usability and understandability of process mining in healthcare. These recommendations are mainly targeted towards process mining researchers and the community to consider when developing a new research agenda for process mining in healthcare. Moreover, a limited number of recommendations are directed towards healthcare organizations and health information systems vendors, when shaping an environment to enable the continuous use of process mining.

Symptom checkers are software tools that allow users to submit a set of symptoms and receive advice related to them in the form of a diagnosis list, health information or triage. The heterogeneity of their potential users and the number of different components in their user interfaces can make testing with end-users unaffordable. We designed and executed a two-phase method to test the respiratory diseases module of the symptom checker Erdusyk. Phase I consisted of an online test with a large sample of users (n=53). In Phase I, users evaluated the system remotely and completed a questionnaire based on the Technology Acceptance Model. Principal Component Analysis was used to correlate each section of the interface with the questionnaire responses, thus identifying which areas of the user interface presented significant contributions to the technology acceptance. In the second phase, the think-aloud procedure was executed with a small number of samples (n=15), focusing on the areas with significant contributions to analyze the reasons for such contributions. Our method was used effectively to optimize the testing of symptom checker user interfaces. The method allowed kept the cost of testing at reasonable levels by restricting the use of the think-aloud procedure while still assuring a high amount of coverage. The main barriers detected in Erdusyk were related to problems understanding time repetition patterns, the selection of levels in scales to record intensities, navigation, the quantification of some symptom attributes, and the characteristics of the symptoms.

Background Electronic health (eHealth) services may help people obtain information and manage their health, and they are gaining attention as technology improves, and as traditional health services are placed under increasing strain. We present findings from the first representative, large-scale, population-based study of eHealth use in Norway. Objective The objectives of this study were to examine the use of eHealth in a population above 40 years of age, the predictors of eHealth use, and the predictors of taking action following the use of these eHealth services. Methods Data were collected through a questionnaire given to participants in the seventh survey of the Tromsø Study (Tromsø 7). The study involved a representative sample of the Norwegian population aged above 40 years old. A subset of the more extensive questionnaire was explicitly related to eHealth use. Data were analyzed using logistic regression analyses. Results Approximately half (52.7%; 9752/18,497) of the respondents had used some form of eHealth services during the last year. About 58% (5624/9698) of the participants who had responded to a question about taking some type of action based on information gained from using eHealth services had done so. The variables of being a woman (OR 1.58; 95% CI 1.47-1.68), of younger age (40-49 year age group: OR 4.28, 95% CI 3.63-5.04), with a higher education (tertiary/long: OR 3.77, 95% CI 3.40-4.19), and a higher income (>1 million kr [US $100,000]: OR 2.19, 95% CI 1.77-2.70) all positively predicted the use of eHealth services. Not living with a spouse (OR 1.14, 95% CI 1.04-1.25), having seen a general practitioner (GP) in the last year (OR 1.66, 95% CI 1.53-1.80), and having had some disease (such as heart disease, cancer, asthma, etc; OR 1.29, 95% CI 1.18-1.41) also positively predicted eHealth use. Self-rated health status did not significantly influence eHealth use. Taking some action following eHealth use was predicted with the variables of being a woman (OR 1.16, 95% CI 1.07-1.27), being younger (40-49 year age group: OR 1.72, 95% CI 1.34-2.22), having a higher education (tertiary/long: OR 1.65, 95% CI 1.42-1.92), having seen a GP in the last year (OR 1.58, 95% CI 1.41-1.77), and having ever had a disease (such as heart disease, cancer or asthma; OR 1.26, 95% CI 1.14-1.39). Conclusions eHealth appears to be an essential supplement to traditional health services for those aged above 40 years old, and especially so for the more resourceful. Being a woman, being younger, having higher education, having had a disease, and having seen a GP in the last year all positively predicted using the internet to get health information and taking some action based on this information.