A randomized comparison between records made with an anesthesia information management system and by hand, and evaluation of the Hawthorne effect

Abstract

Purpose Anesthesia information management system (AIMS) technology is designed to facilitate high-quality anesthetic recordkeeping. We examined the hypothesis that no difference exists between AIMS and handwritten anesthetic records in regard to the completeness of important information contained as text data. We also investigated the effect of observational research on the completeness of anesthesiologists' recordkeeping. Methods As part of a larger randomized controlled trial, participants were randomized to produce 400 anesthetic records, either handwritten (n = 200) or using an AIMS (n = 200). Records were assessed against a 32-item checklist modified from a clinical guideline. Intravenous agent and bolus recordings were quantified, and data were compared between handwritten and AIMS records. Records produced with intensive research observation during the initial phase of the study (n = 200) were compared with records produced with reduced intensity observation during the final phase of the study (n = 200). Results The AIMS records were more complete than the handwritten records (mean difference 7.1%; 95% confidence interval [CI] 5.6 to 8.6%; P \ 0.0001), with higher completion rates for six individual items on the checklist (P \ 0.0001). Drug annotation data were equal between arms. The records completed early in the study, during a period of more intense observation, were more thorough than subsequent records (87.3% vs 81.6%, respectively; mean difference 5.7%; 95% CI 4.2 to 7.3%; P \ 0.0001). Conclusions The AIMS records were more complete than the handwritten records for 32 predefined items. The potential of observational research to influence professional behaviour in an anesthetic context was confirmed. This trial was registered at the Australian New Zealand Clinical Trials Registry No 12608000068369.

Monitoring Anesthesia Care Delivery and Perioperative Mortality in Kenya Utilizing a Provider-driven Novel Data Collection Tool

“…It is possible that emphasis on monitoring and improving outcome metrics engendered increased vigilance and more diligent care during each case. 29 Third, it is possible that case mix shifted to healthier patients or lower acuity without being detected in the REDCap tool, independently lowering mortality risk. A future study is needed to prospectively test the possibility that the introduction of an initiative of this type might improve outcomes.…”

A clinical audit cycle of post‐operative hypothermia in dogs

“…A common weakness of clinical audit is the likelihood of observing the Hawthorne effect in which human behaviour is modified as a result of being observed (Parsons , Edwards et al . ). When this results in improved patient care we view this as a positive effect, provided improvements in care can be sustained beyond the completion of the audit (the period of observation).…”

Improving Quality Metric Adherence to Minimally Invasive Breast Biopsy among Surgeons Within a Multihospital Health Care System

“…[31][32][33] Using such strategies of data collection with the goal of monitoring/recording performance and patient outcomes leading to improvement in patient care quality, presumably because of awareness of being studied, has been described in radiology, anesthesia, orthopaedic surgery, obstetrics, gastroenterology, cardiothoracic surgery, pediatrics, and palliative medicine. [34][35][36][37][38][39][40][41] Similarly, this Hawthorne effect phenomenon, when combined with the innate perfectionism and exaggerated sense of responsibility that characterizes the surgeon personality, 42 can be a powerful driver of behavioral change. General surgeons with a vested interest in performing breast cancer surgery improve their quality metric adherence when their performance is brought to their attention and their outcomes are visibly lower than their breast-dedicated and general surgery peers.…”