Hawthorne effect on surgical studies

Abstract

Background The Hawthorne effect or ‘observer effect’ describes a change in normal behaviour when individuals are aware they are being observed. This may have an impact on effect estimates in clinical trials. The purpose of this study was to determine if the Hawthorne effect had been recorded as a risk of bias in surgical studies. Methods A Preferred Reporting Items for Systematic Reviews and Meta‐Analyses compliant literature search was conducted till March 2019. Eligible studies included those reporting or not reporting the Hawthorne effect in surgical studies from the following databases: MEDLINE, Embase, CINAHL, AMED, BNI, HMIC, PsycINFO, Web of Science, Cochrane Library, Google Scholar and OpenGrey. Two reviewers independently reviewed the papers, extracted data and appraised study methods using the Newcastle Ottawa Scale or the Cochrane risk of bias tool. Data were analysed descriptively. Results A total of 842 papers were identified, of which 16 were eligible. Six (37%) observational studies were identified with the aim of measuring the Hawthorne effect on their outcome with five reporting that the Hawthorne effect was responsible for the improvements in outcomes and one reporting no change in outcome due to the Hawthorne effect. Ten (63%) studies were identified, of which eight used the Hawthorne effect as an explanation to improvements seen in the control group or their secondary outcomes and two to compare their results with other studies. Conclusion There is considerable between‐study heterogeneity on how the Hawthorne effect relates to surgical outcomes. Further consideration on reporting and considering the importance of the Hawthorne effect in the design of surgical trials is warranted.

A study to assess the effectiveness of a structured teaching programme on knowledge and practice of safe insulin administration among nurses in a tertiary care hospital: A pre-post design

“…Furthermore, since the trainer was observing the practices, Hawthorne effect cannot be ruled out. [39] However, as seen in our results, even though the practices improved, some of them did not improve as much as others. The mean age in our study was 25.9; hence there may be concerns that the population of nurses included in the study is relatively young.…”

Validation of MTL30 as a quality indicator for colorectal surgery

“…It has been shown previously that in addition to directly comparing between hospitals, self-evaluation leads to an increase in quality in individual hospitals, which is referred to as the Hawthorne effect [ 26 ]. The morbidity and mortality in participating hospitals decreased significantly due to the introduction of NSQIP [ 27 ].…”

Surgical cognitive simulation improves real-world surgical performance: randomized study

“…This would not be the case if the study had omitted evaluations during routine working in the operating theatre. Simulated assessments have been shown to offer a reasonably good reflection of performance in the real world 39 . In addition, as SCS is a subjective process, subjective assessment needed to be considered.…”

“…In addition, as SCS is a subjective process, subjective assessment needed to be considered. A Hawthorne effect—the temporary alteration of behaviour by the subjects of a study owing to their awareness of being observed—cannot be discounted 39 .…”