Six histopathologists allocated 100 sections from patients with long-standing ulcerative colitis into four diagnostic categories, regular hyperplasia, reactive atypia, low-grade and high-grade dysplasia. Their allocations were analysed using kappa statistics, including Fleiss's multiple kappa for groups of observers, and agreement on specific diagnoses was explored by constructing a conditional probability matrix. The nature of their disagreements was investigated using coefficients for systematic and haphazard errors. Over the four diagnostic categories there was a wide range of pairwise agreement from a low of 49% up to 72% and kappa values were only 'fair' or 'moderate'. As expected, agreement over the two categories 'dysplasia' vs 'no dysplasia' was better, ranging from 68% to 84%, and for 'atypia present' (reactive atypia, low- and high-grade dysplasia) vs "no atypia' two pairings achieved over 90% and 11 pairings over 80% agreement. In view of its clinical importance, conditional agreement on high-grade dysplasia, pairwise agreement on this diagnosis ranged from 100% down to as low as 33%. However, most of these disagreements fell into the low-grade dysplasia category so that closer follow-up and further biopsies would still have been indicated. It is a truism that the basis for safe management is careful co-operation between clinicians and pathologists who have all the relevant facts and who know and trust one another's judgement. Thus, several aspects of the ideal diagnostic process cannot be evaluated in inter-observer studies and the element of artificiality should be borne in mind when applying the findings to diagnostic practice. Nevertheless, the low level of agreement on the diagnosis of high-grade dysplasia achieved by certain pairings of specialist pathologists is a disturbing outcome of this study. Inaccuracies should be minimized by a concensus approach and we therefore recommend referral of putative cases of dysplasia to interested pathologists for further opinions. We would also advocate that pathologists faced with appearances which are indefinite between reactive atypia and dysplasia, would do better to describe them in terms of "atypia, significance uncertain', so that closer surveillance is undertaken, rather than force them into more precise diagnostic categories which may be incorrect.
In an international study, psychometric properties of the Care Dependency Scale (CDS) were examined by analysing data gathered in Dutch, Canadian, Italian and Norwegian nursing homes. For that purpose, from these countries a convenience sample was developed consisting of 525 patients with dementia. The English, Italian and Norwegian research instruments were translations of the original Dutch CDS. Psychometric evaluations of the CDS were carried out for each country separately as well as for the four countries combined. High alpha coefficients between 0.94 and 0.97 were calculated. Subsequent test-retest and inter-rater reliability revealed moderate to substantial Kappa values. Factor analysis resulted in a one-factor solution. The scalability of the CDS was demonstrated by means of Mokken scale analysis. One of the main outcomes of the cross-cultural comparison was that the findings in the four countries show more similarities than differences, so that the scale can be used appropriately in nursing home practice.
SUMMARY Observer variation in the grading of dysplasia in 100 colorectal adenomas has been analysed by kappa statistics. Intraobserver agreement was only 70% and 67% for the two principal observers, and, as would be expected, interobserver agreement was even lower at 59% and 66%. Although the kappa values were significantly different from chance at the 0*1% level, there were substantial disagreements. When the study was extended to four observers, agreement between observer pairings was considerably worse (as low as 34%), and in four pairings the kappa values did not differ significantly from those expected by chance alone even at the 5% level.In an endeavour to improve agreement we adopted a percentage estimation grading method; but this failed to achieve any improvement when comparing overall grades. The percentage estimates of the two observers, however, showed a highly significant correlation.To identify the cytological features given most weight by the principal observers in assessing dysplasia we undertook morphometry on 30 adenomas using an image analysis computer. The nuclear to cytoplasmic ratio, variation in nuclear area, and variation in nuclear height above the basement membrane showed significant differences between mild, moderate, and severely dysplastic epithelia. While evaluation of these parameters therefore appears to be most important in the subjective interpretation of dysplasia, this study has shown that such evaluation is poorly standardised between observers and poorly reproduced within observers.Our finding of poor agreement in the grading of dysplasia in colorectal adenomas has serious implications for the assessment of dysplasia in inflammatory bowel disease, where the added problem of reactive cellular atypia brings greater complexity to these subjective judgments.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.