Adult Vulvar Lichen Sclerosus: Can Experts Agree on the Assessment of Disease Severity?

Abstract

Objective The objective of this study was to test the severity rating of the signs and architectural changes for interrater reliability among world experts via analysis of lichen sclerosus (LS) photographs. Methods A recent Delphi consensus exercise established a list of symptoms, signs, and architectural changes, which experts feel are important to include in a severity scale. Photographs of vulvar LS were manually extracted from patient charts and 50 photographs with a range of severity of signs and architectural changes were chosen. Lichen sclerosus experts were invited to take part in the study and 3 dermatologists and 3 gynecologists were selected for their expertise and geographic variety. Raters assessed the photographs for multiple signs and architectural changes as well as an overall impression of disease severity on a 4-point Likert scale. Intraclass correlation coefficients were calculated. Results The intraclass correlation coefficients were very poor for individual signs and architectural changes as well as for overall disease severity when analyzed for all 6 raters as well as when analyzed with dermatologists' and gynecologists' responses grouped separately. There were no statistically significant correlations found. Conclusions Global experts were unable to agree on any signs, architectural changes, or an overall global impression to assess vulvar LS disease severity based on analysis of vulvar photographs. Standardized descriptions regarding what constitutes mild, moderate, and severe signs and anatomical changes are required before further scale development can occur.

Does longer duration of corticosteroid treatment improve clearance in vulvar lichen sclerosus? Results from a single centre, comparative, open label study

“…The investigators who scored VLS signs were not blinded to treatment. Since univocal and validated methods to assess VLS severity as well as univocal definition of response are not available in the literature, 17 , 18 we chose to consider different outcome measures for assessing efficacy, in order to reduce the risk of methodological bias. In order to address the issue of patients' adherence to treatment, the rate of dropouts was considered whereas the true level of adherence was not objectively proved.…”

Proposition of a severity scale for lichen sclerosus: The “Clinical Lichen Sclerosus Score”

“…The CLISSCO, as a first attempt to combine the items of the Delphi consensus study into a scale, showed an excellent overall interrater reliability. Recently, Sheinis et al 28 reported a significantly lower ICC obtained six experts who evaluated 50 photos of VLS based on the signs and architectural changes proposed by the Delphi Consensus study. This discrepancy may be attributable to several reasons: (a) Our preassessment training of the raters, (b) the more detailed patient including symptoms our raters have been provided with, (c) and the similar specialty training our raters had.…”

Fractionated Carbon Dioxide Laser for the Treatment of Vulvar Lichen Sclerosus

“…Moreover, studies have shown that experts are unable to agree on architectural changes or signs of disease severity when rating photographs of patients with vulvar lichen sclerosus. 6 A recently proposed severity scale, the Clinical Lichen Sclerosus Score, shows promise but has not yet been validated. 7 Authors of both studies acknowledge significant placebo effect.…”