Item Discrimination: When More Is Worse

Abstract

High item discrimination can be a symptom o f a special kind of measurement disturbance introduced by an item that gives persons o f high ability a special advantage over and above their higher abilities. This type o f disturbance, which can be interpreted as a form o f item “bias,” can be encouraged by methods that routinely interpret highly discriminating items as the “best” items on a test and may be compounded by procedures that weight items by their discrimination. The type of measurement disturbance described and illustrated in this paper occurs when an item is sensitive to individual differences on a second, undesired dimension that is positively correlated with the variable intended to be measured. Possible secondary influences o f this type include opportunity to learn, opportunity to answer, and test wiseness

How Lesbian and Heterosexual Parents Convey Attitudes about Gender to their Children: The Role of Gendered Environments

“…Higher values than expected indicate that the data are more random than predicted, whereas lower values indicate overfit, where the item, person, or rater is providing less information than expected. Overfit can be from any of a number of sources (Wright 1991) including multidimensionality (Masters 1988) and differential usage of the rating scale (Bowles 1999). The standardized fit statistics have associated statistical tests for significant misfit, based on a z-test.…”

A Boundary Mixture Approach to Violations of Conditional Independence

“…This is especially an issue for the discrimination parameters, the standard errors of the latent trait estimate and related test reliability (see e.g., Sireci, Thissen, & Wainer, 1991;Chen & Thissen, 1997;Masters, 1988;Yen, 1984).…”

Avaliação da qualidade do Enem 2009 e 2011 com técnicas psicométricas

“…Para garantir a precisão do teste, é desejável que a discriminação seja alta, para que o item seja mais informativo em certa porção da escala, embora haja evidências de que uma discriminação muito alta possa produzir distorções (MASTERS, 1988). A dificuldade do item, por sua vez, não deve ser muito alta ou muito baixa, caso contrário o item apresenta pouca informação sobre a população analisada.…”