The Effect of Abnormality-Prevalence Expectation on Expert Observer Performance and Visual Search

Reed, Warren; Ryan, John; McEntee, Mark F.; Evanoff, Michael G.; Brennan, Patrick C.

doi:10.1148/radiol.10101090

Cited by 72 publications

(46 citation statements)

References 25 publications

(18 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…We enriched our sample to ensure an adequate number of higher fracture severities would be present. We believe that this is unlikely to have influenced agreement [22] and reliability measures, as previous studies investigating the prevalence of vertebral fractures on routine clinical CT showed prevalence of vertebral fractures similar to ours, ranging from 10–35% [23]–[26]. Finally, the clinical histories of the included patients were not available within the PROVIDI cohort.…”

Section: Discussionmentioning

confidence: 74%

Intra and Interobserver Reliability and Agreement of Semiquantitative Vertebral Fracture Assessment on Chest Computed Tomography

et al. 2013

View full text Add to dashboard Cite

ObjectivesTo evaluate the reliability of semiquantitative Vertebral Fracture Assessment (VFA) on chest Computed Tomography (CT).MethodsFour observers performed VFA twice upon sagittal reconstructions of 50 routine clinical chest CTs. Intra- and interobserver agreement (absolute agreement or 95% Limits of Agreement) and reliability (Cohen's kappa or intraclass correlation coefficient(ICC)) were calculated for the visual VFA measures (fracture present, worst fracture grade, cumulative fracture grade on patient level) and for percentage height loss of each fractured vertebra compared to the adjacent vertebrae.ResultsObservers classified 24–38% patients as having at least one vertebral fracture, giving rise to kappa's of 0.73–0.84 (intraobserver) and 0.56–0.81 (interobserver). For worst fracture grade we found good intraobserver (76–88%) and interobserver (74–88%) agreement, and excellent reliability with square-weighted kappa's of 0.84–0.90 (intraobserver) and 0.84–0.94 (interobserver). For cumulative fracture grade the 95% Limits of Agreement were maximally ±1,99 (intraobserver) and ±2,69 (interobserver) and the reliability (ICC) varied from 0.84–0.94 (intraobserver) and 0.74–0.94 (interobserver). For percentage height-loss on a vertebral level the 95% Limits of Agreement were maximally ±11,75% (intraobserver) and ±12,53% (interobserver). The ICC was 0.59–0.90 (intraobserver) and 0.53–0–82 (interobserver). Further investigation is needed to evaluate the prognostic value of this approach.ConclusionIn conclusion, these results demonstrate acceptable reproducibility of VFA on CT.

show abstract

Section: Discussionmentioning

confidence: 74%

Intra and Interobserver Reliability and Agreement of Semiquantitative Vertebral Fracture Assessment on Chest Computed Tomography

et al. 2013

View full text Add to dashboard Cite

show abstract

“…Perceptions are greatly influenced by expectations [20]. Previous research has demonstrated how prior expectation might bias perceptual decisions [21,22]. We investigated whether an expectation of abnormality affects visual search by altering clinical information when looking for pulmonary nodules in adult chest radiographs.…”

Section: Discussionmentioning

confidence: 99%

Does Expectation of Abnormality Affect the Search Pattern of Radiologists When Looking for Pulmonary Nodules?

et al. 2016

View full text Add to dashboard Cite

This experiment investigated whether there might be an effect on the visual search strategy of radiologists during image interpretation of the same adult chest radiographs when given different clinical information. Each of 17 experienced radiologists was asked to interpret a set of 57 (10 abnormal) posteroanterior chest images to identify the presence of pulmonary lesions using differing clinical information (leading to unknown, low and high expectations of prevalence). Eye position metrics (search time, dwell time and time to first fixation) were compared for normal and abnormal images, as well as between conditions. For all images, there was a significantly longer search time at high prevalence expectation compared to low prevalence expectation (W = 75.19, P = <0.0001). Mann-Whitney analysis of the abnormal images demonstrated that the dwell time on correctly identified lesions was significantly shorter at low prevalence expectation compared to both unknown (U = 364.5, P = 0.02) and high prevalence expectation (U = 397.0, P = 0.0002). Visual search patterns of radiologists appear to be affected by changing a priori information where such information fosters an expectation of abnormality.

show abstract

“…[35][36][37][38][39] A number of studies have even looked at how eye tracking studies need to be conducted to yield the most valid results. [40][41][42][43][44] Only examples of eye tracking experiments that used conventional radiography were named here due to their large numbers.…”

Section: Introductionmentioning

confidence: 99%

Review of prospects and challenges of eye tracking in volumetric imaging

Venjakob

Mello‐Thoms

2015

J. Med. Imag

View full text Add to dashboard Cite

Abstract. While eye tracking research in conventional radiography has flourished over the past decades, the number of eye tracking studies that looked at multislice images lags behind. A possible reason for the lack of studies in this area might be that the eye tracking methodology used in the context of conventional radiography cannot be applied one-on-one to volumetric imaging material. Challenges associated with eye tracking in volumetric imaging are particularly associated with the selection of stimulus material, the detection of events in the eye tracking data, the calculation of meaningful eye tracking parameters, and the reporting of abnormalities. However, all of these challenges can be addressed in the design of the experiment. If this is done, eye tracking studies using volumetric imaging material offer almost unlimited opportunity for perception research and are highly relevant as the number of volumetric images that are acquired and interpreted is rising.

show abstract

The Effect of Abnormality-Prevalence Expectation on Expert Observer Performance and Visual Search

Cited by 72 publications

References 25 publications

Intra and Interobserver Reliability and Agreement of Semiquantitative Vertebral Fracture Assessment on Chest Computed Tomography

Intra and Interobserver Reliability and Agreement of Semiquantitative Vertebral Fracture Assessment on Chest Computed Tomography

Does Expectation of Abnormality Affect the Search Pattern of Radiologists When Looking for Pulmonary Nodules?

Review of prospects and challenges of eye tracking in volumetric imaging

Contact Info

Product

Resources

About