Abstract:The Sarnoff JNDmetrix visual discrimination model (VDM) was applied to predict human psychophysical performance in the detection of simulated mammographic lesions. Contrast thresholds for the detection of synthetic Gaussian "masses" on mean backgrounds and simulated mammographic backgrounds were measured in two-alternative, forcedchoice (2AFC) trials. Experimental thresholds for 2-D Gaussian signal detection decreased with increasing signal size on mean backgrounds and on 1/f 3 filtered noise images presented … Show more
“…22 Another method of using perceptual difference models is by assessing the discriminability between an image containing a signal and the same image without the signal. [19][20][21]43 This second method was also investigated to measure signal detectability as a function of compression. Although the detailed results are not presented in this proceedings paper, we found that this method was unsuccessful in predicting the degradation in human performance with compression ratio.…”
There have been two distinct approaches to develop human vision models that can be used to perform automated evaluation and optimization of medical image quality: linear task based model observers vs. perceptual difference/image discrimination models. Although these two approaches are very different there has been little work directly comparing them in their ability to optimize human performance in clinically relevant tasks. We compared the effectiveness of these two types of metrics of image quality to perform automated computer optimization of JPEG 2000 image compression encoder settings using test images that combined real x-ray coronary angiogram backgrounds with simulated filling defects of 184 different size/shapes. A genetic algorithm was used to optimize the JPEG 2000 encoder settings with respect to: a) a particular task based model observer performance (non-prewhitening matched filter with an eye filter, NPWE; b) a particular perceptual difference/image discrimination model error metric (DCTune2.0; NASA Ames Research Center). A subsequent human psychophysical study was conducted to evaluate the effect of the two different optimized compression encoder settings on visual detection of the simulated filling defect in one of four locations (four alternative forced choice; 4 AFC). Results show that optimizing JPEG 2000 encoder settings with respect to both the NPWE performance and DCTune 2.0 perceptual error lead to improved human task performance relative to human performance with the default encoder settings. However, the NPWE-optimization led to much greater human performance improvement than the perceptual difference model optimization.
“…22 Another method of using perceptual difference models is by assessing the discriminability between an image containing a signal and the same image without the signal. [19][20][21]43 This second method was also investigated to measure signal detectability as a function of compression. Although the detailed results are not presented in this proceedings paper, we found that this method was unsuccessful in predicting the degradation in human performance with compression ratio.…”
There have been two distinct approaches to develop human vision models that can be used to perform automated evaluation and optimization of medical image quality: linear task based model observers vs. perceptual difference/image discrimination models. Although these two approaches are very different there has been little work directly comparing them in their ability to optimize human performance in clinically relevant tasks. We compared the effectiveness of these two types of metrics of image quality to perform automated computer optimization of JPEG 2000 image compression encoder settings using test images that combined real x-ray coronary angiogram backgrounds with simulated filling defects of 184 different size/shapes. A genetic algorithm was used to optimize the JPEG 2000 encoder settings with respect to: a) a particular task based model observer performance (non-prewhitening matched filter with an eye filter, NPWE; b) a particular perceptual difference/image discrimination model error metric (DCTune2.0; NASA Ames Research Center). A subsequent human psychophysical study was conducted to evaluate the effect of the two different optimized compression encoder settings on visual detection of the simulated filling defect in one of four locations (four alternative forced choice; 4 AFC). Results show that optimizing JPEG 2000 encoder settings with respect to both the NPWE performance and DCTune 2.0 perceptual error lead to improved human task performance relative to human performance with the default encoder settings. However, the NPWE-optimization led to much greater human performance improvement than the perceptual difference model optimization.
“…Since the threshold data that we had gathered at that time for those backgrounds and signals had exhibited negative C-D slopes, their use in LP channel calibration ensured that the VDM would predict negative C-D slopes for those images. 8 More recent work 9 has shown that the absence of fixation cues scaled to signal size was primarily responsible for the negative C-D characteristics found in our earlier experiments. Fixation cues enhance detection by reducing uncertainty in signal location for the human observer.…”
Section: Introductionmentioning
confidence: 88%
“…7 In an earlier study, we also found experimentally a positive contrast-detail (C-D) slope for Gaussian "masses" in 1/f 3 filtered noise images when different backgrounds were used in the 2AFC trials; when the same background was used for both locations, however, we observed smaller detection thresholds and a negative C-D slope, i.e., larger Gaussians were more conspicuous that smaller Gaussians, in qualitative agreement with our threshold data for Gaussian detection on mean-luminance backgrounds. 8 When we first began simulating Gaussian detection thresholds with the JNDmetrix VDM, a lowpass (LP) channel was introduced in the model to provide an appropriate response to signals, such as Gaussians, with an amplitude in the frequency domain that increases as frequency approaches zero. The sensitivity and masking parameters of this new channel required psychophysical data for proper calibration relative to the existing bandpass channels, which respond to higher spatial frequencies and had been calibrated previously to fit psychophysical thresholds for the detection and discrimination of sine gratings.…”
Previous studies in which the JNDmetrix visual discrimination model (VDM) was applied to predict effects of image display and processing factors on lesion detectability have shown promising results for mammographic images with microcalcification clusters. In those studies, just-noticeable-difference (JND) metrics were computed for signal-present and signal-absent image pairs with the same background. When this "paired discriminability" method was applied to Gaussian signals in 1/f 3 filtered noise, however, it was unable to predict detection thresholds measured in 2AFC trials for different backgrounds. We suggested previously (SPIE 2002) that a statistical model observer using channel responses from "single-ended" VDM simulations could predict detection performance with different backgrounds. The implementation and evaluation of that VDM-channelized model observer is described in this paper. Model performance was computed for sets of signal and noise images from two observer performance studies involving the detection of simulated or real breast masses. For the first study, the VDM-channelized model observer was able to predict the dependence of detection thresholds on signal size (contrast-detail slope) for 2AFC detection of Gaussian signals on different 1/f 3 noise backgrounds. Variations in the detectability of masses in mammograms from the second study correlated well with model performance as a function of display type (LCD vs. CRT) and viewing angle (on-axis vs. 45° off-axis). The performance of the VDM-channelized model observer was superior to results obtained using either the VDM paired discriminability method or a conventional nonprewhitening model observer.
“…21 JND channel maps were generated using "single-ended" simulations in which each test image from the signal (signal-present) and noise (signal-absent) sets was paired with a uniform, mean-luminance reference image. Model input in this case is a measure of the contrast visibility in a given test image.…”
CRT displays are generally used for softcopy display in the digital reading room, but LCDs are being used more frequently. LCDs have many useful properties, but can suffer from significant degradation when viewed off-axis. We compared observer performance and human visual system model performance for on and off-axis CRT and LCD viewing. 400 mammographic regions of interest with different lesion contrasts were shown on and off-axis to radiologists on a CRT and LCD. Receiver Operating Characteristic (ROC) techniques were used to analyze observer performance and results were correlated with the predictions of the human vision model (JNDmetrix model). Both sets of performance metrics showed that LCD on-axis viewing was better than the CRT; and off-axis was significantly better with the CRT. Off-axis LCD viewing of radiographs can degrade observer performance compared to a CRT.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.