Can a Checklist Reduce SOS Errors in Chest Radiography?

Berbaum, Kevin S.; Franken, Edmund A.; Caldwell, Robert T.; Schartz, Kevin M.

doi:10.1016/j.acra.2005.11.032

Cited by 46 publications

(39 citation statements)

References 22 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This experiment was performed using 57 radiographic examinations of the chest that had been used in earlier SOS studies [1,3,16,17]. Thirty cases had diverse, subtle, and clinically important native abnormalities, and 27 had no native abnormalities.…”

Section: Case Samplementioning

confidence: 99%

Does Computer-Aided Diagnosis for Lung Tumors Change Satisfaction of Search in Chest Radiography?

et al. 2007

Self Cite

View full text Add to dashboard Cite

Rationale and Objectives-Computer-aided diagnosis (CAD) has been developed to ensure that the radiologist considers suspect focal opacities that may represent cancer in chest radiography. Although CAD was not developed to counteract the satisfaction of search (SOS) effect, it may be an effective intervention to do so. The objective of this study is to determine whether an idealized CAD can reduce SOS effects in chest radiography.Materials and Methods-Fifty-seven chest radiographs, half of which demonstrated diverse, native abnormalities were read twice by 16 observers, once with and once without the addition of a simulated pulmonary nodule. Simulated CAD prompts were provided during the interpretation, which unerringly pointed to the added simulated nodule. Area under the ROC curve for detecting the native abnormalities was estimated for each observer in each treatment condition. In addition to testing for the SOS effect in the presence of CAD prompts, results were compared to those of a previous SOS study.Results-Significantly more nodules were reported in the SOS with CAD experiment than in the original SOS experiment (49 vs. 43, p < 0.01). An SOS effect was found even when CAD prompts were provided; ROC areas for detecting native abnormalities were reduced with added nodules (0.68 vs. 0.65, p(one-tailed) < 0.05). Comparison of the current experiment with CAD and the previous SOS experiments failed to show a significant difference of the magnitude of the SOS effect (p = 0.52). The threshold for reporting was more conservative with CAD prompts than in SOS studies (p = 0.052).Conclusion-Our results indicate that the CAD prompts, even those that always point to their target lesion without false-positive error, fail to counteract SOS in chest radiography. The stricter decision thresholds with CAD prompts may indicate less visual search for native abnormalities.

show abstract

Section: Case Samplementioning

confidence: 99%

Does Computer-Aided Diagnosis for Lung Tumors Change Satisfaction of Search in Chest Radiography?

et al. 2007

Self Cite

View full text Add to dashboard Cite

show abstract

“…This approach involves making an initial hypothesis prior to making observations that are directed to address the hypothesis [14,15]. This method would include a nondirected or free search approach.…”

mentioning

confidence: 99%

“…Third, fixating on the potential abnormality allows the viewer to interpret the data to determine whether or not it is a negative or positive finding [22]. Detection errors have been reported to occur at any level along the visual search process and may be affected by method of search [14,15,23,24].…”

mentioning

confidence: 99%

See 1 more Smart Citation

VFS Interjudge Reliability Using a Free and Directed Search

2011

Self Cite

View full text Add to dashboard Cite

Reports in the literature suggest that clinicians demonstrate poor reliability in rating videofluoroscopic swallow (VFS) variables. Contemporary perception theories suggest that the methods used in VFS reliability studies constrain subjects to make judgments in an abnormal way. The purpose of this study was to determine whether a directed search or a free search approach to rating swallow studies results in better interjudge reliability. Ten speech pathologists served as judges. Five clinical judges were assigned to the directed search group (use checklist) and five to the free search group (unguided observations). Clinical judges interpreted 20 VFS examinations of swallowing. Interjudge reliability of ratings of dysphagia severity, affected stage of swallow, dysphagia symptoms, and attributes identified by clinical judges using a directed search was compared with that using a free search approach. Interjudge reliability for rating the presence of aspiration and penetration was significantly better using a free search ("substantial" to "almost perfect" agreement) compared to a directed search ("moderate" agreement). Reliability of dysphagia severity ratings ranged from "moderate" to "almost perfect" agreement for both methods of search. Reliability for reporting all other symptoms and attributes of dysphagia was variable and was not significantly different between the groups.

show abstract

“…second nodule visible at the chest radiograph [11]. That human factor limitation can be handled with double reading [12]. Unfortunately, none of the current CAD systems deal with the SOS effect [13], so a second expert observer is normally required for double reading.…”

Section: Introductionmentioning

confidence: 99%

Implication of the first decision on visual information-sampling in the spatial frequency domain in pulmonary nodule recognition

Pietrzyk

Manning

Donovan

et al. 2010

Medical Imaging 2010: Image Perception, Observer Performance, and Technology Assessment

View full text Add to dashboard Cite

Usage of any items from the University of Cumbria's institutional repository 'Insight' must conform to the following fair usage guidelines.Any item and its associated metadata held in the University of Cumbria's institutional repository Insight (unless stated otherwise on the metadata record) may be copied, displayed or performed, and stored in line with the JISC fair dealing guidelines (available here) for educational and not-for-profit activities provided that• the authors, title and full bibliographic details of the item are cited clearly when any part of the work is referred to verbally or in the written form• a hyperlink/URL to the original Insight record of that item is included in any citations of the work • the content is not changed in any way• all files required for usage of the item are kept together with the main item file. You may not• sell any part of an item• refer to any part of an item without citation • amend any item or contextualise it in a way that will impugn the creator's reputation• remove or alter the copyright statement on an item.The full policy can be found here. Alternatively contact the University of Cumbria Repository Editor by emailing insight@cumbria.ac.uk. To investigate the impact on visual sampling strategy and pulmonary nodule recognition of image-based properties of background locations in dwelled regions where the first overt decision was made. . Background: Recent studies in mammography show that the first overt decision (TP or FP) has an influence on further image reading including the correctness of the following decisions. Furthermore, the correlation between the spatial frequency properties of the local background following decision sites and the first decision correctness has been reported. Methods: Subjects with different radiological experience were eye tracked during detection of pulmonary nodules from PA chest radiographs. Number of outcomes and the overall quality of performance are analysed in terms of the cases where correct or incorrect decisions were made. JAFROC methodology is applied. The spatial frequency properties of selected local backgrounds related to a certain decisions were studied. ANOVA was used to compare the logarithmic values of energy carried by non redundant stationary wavelet packet coefficients. Results: A strong correlation has been found between the number of TP as a first decision and the JAFROC score (r = 0.74). The number of FP as a first decision was found negatively correlated with JAFROC (r = -0.75). Moreover, the differential spatial frequency profiles outcomes depend on the first choice correctness. Implication of the first decision on visual information-sampling in the Spatial Frequency domain in pulmonary nodule recognition

show abstract

Can a Checklist Reduce SOS Errors in Chest Radiography?

Cited by 46 publications

References 22 publications

Does Computer-Aided Diagnosis for Lung Tumors Change Satisfaction of Search in Chest Radiography?

Does Computer-Aided Diagnosis for Lung Tumors Change Satisfaction of Search in Chest Radiography?

VFS Interjudge Reliability Using a Free and Directed Search

Implication of the first decision on visual information-sampling in the spatial frequency domain in pulmonary nodule recognition

Contact Info

Product

Resources

About