Full of Surprises: Performance Validity Testing in Examinees with Limited English Proficiency

Crisan, Iulia; Matei, Alina; Avram, Diana-Luisa; Bunghez, Cătălina; Erdodi, Laszlo A.

doi:10.1007/s12207-023-09474-4

Cited by 4 publications

(3 citation statements)

References 146 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Abeare et al, 2018). Third, our results may underestimate BR Fail in ethnically and linguistically diverse populations (Ali et al, 2022;Brantuo et al, 2022;Crişan et al, 2023;Holcomb et al, 2022). Until clear empirical guidelines are developed, the best practice may be to require a higher level of evidence of noncredible responding in such examinees before declaring the response set invalid (Braw, 2021).…”

Section: Constraints On Generalizabilitymentioning

confidence: 84%

“…Consequently, cutoffs are calibrated to maximize specificity (Chafetz, 2022). Nevertheless, concerns about misclassifying response sets as invalid due to genuine, severe cognitive impairment (Messa et al, 2022; Tyson et al, 2023), limited English proficiency (Ali et al, 2022; Crişan et al, 2023), or race (Holcomb et al, 2022; Pearson, 2009) persist and are substantiated by empirical evidence.…”

mentioning

confidence: 99%

See 1 more Smart Citation

Base rates of failure on various performance validity tests as a function of age in adults referred for neuropsychological assessment.

Rai,

Gervais,

Rodrigues

et al. 2024

Psychological Assessment

View full text Add to dashboard Cite

This study aimed to investigate the relationship between age and base rates of failure (BRFail) on various performance validity tests (PVTs) administered in medical–legal settings. Archival data were analyzed from 3,297 adults (Mage = 42.3 years; Meducation = 11.2) referred for psychological or neuropsychological assessments in a medical–legal or forensic civil disability context who passed the Word Memory Test. BRFail on 10 PVTs (three freestanding and seven embedded) were reported at multiple cutoffs across five age groups ranging from 16 years to 69 years. BRFail increased with age on most embedded PVTs, with a couple of notable exceptions. Reliable Digit Span was unrelated to age at ≤6 but produced elevated BRFail among older examinees at ≤7. Within freestanding PVTs, a positive relationship emerged between age and BRFail on most instruments/cutoffs. Older age is associated with an increased risk of false positive errors on many embedded PVTs that rely on raw scores. Although freestanding PVTs tend to be more resistant to the effects of age, several commonly used cutoffs may still produce increased false positive rates in older examinees. Taken together, results suggest that PVT scores should be interpreted in the context of patient characteristics, in an evidence-based manner, rather than by rigidly applying omnibus cutoffs.

show abstract

Section: Constraints On Generalizabilitymentioning

confidence: 84%

mentioning

confidence: 99%

Base rates of failure on various performance validity tests as a function of age in adults referred for neuropsychological assessment.

Rai,

Gervais,

Rodrigues

et al. 2024

Psychological Assessment

View full text Add to dashboard Cite

show abstract

“…Along these lines, cultural and linguistic “match” between examiners and examinees, which would not require the use of an interpreter, seems to be associated with lower false positive rates of PVTs in Chinese immigrant and native Japanese samples (Chang et al, 2023; Ryan et al, 2019). There is also recent evidence to suggest PVT outcomes in individuals with limited English proficiency may be influenced by the type of population tested and the PVT instrument used (Crisan et al, 2023). These findings highlight the importance of ensuring the validity and utility of PVTs in CALD samples and that their contents are translated effectively to reduce gaps in cultural and language differences that may impede accurate interpretation of scores.…”

Section: The Present Studymentioning

confidence: 99%

Measures of performance validity for Hispanic/Latin American adults: A PRISMA systematic review.

Gonzalez,

Escamilla,

Medina

2024

Psychology & Neuroscience

View full text Add to dashboard Cite

Objective: The use of performance validity tests (PVTs) to assess suboptimal performance has become a recommended feature in neuropsychological evaluations. However, most of the literature has examined the utility of PVTs in primarily non-Hispanic White, monolingual English-speaking samples. Given the continual growth of culturally and linguistically diverse populations, especially Hispanic/Latin Americans (H/Ls), it is necessary to provide an updated review of the available literature involving the use of PVTs in H/L adults. Method: We conducted a systematic review that examined the available literature surrounding the use of performance validity measures in H/L adults. This review identified evidence for the utility of PVTs in assessing invalid performance in H/Ls and compiled psychometric properties related to these measures, specifically rates of specificity and sensitivity when available. Results: We identified six standalone and four embedded performance validity measures that have been examined in H/Ls. The Test of Memory Malingering was identified as the PVT most studied in various H/L heritage groups. Across the studies reviewed, adjustments to cutoff scores are generally recommended for the majority of PVTs discussed. Within H/Ls, specificity rates tend to be bolstered when sociocultural factors, like education, are considered. Conclusions: Recommended cutoff scores across the different PVTs reviewed are not typically suitable for use in heritage groups of H/L adults, especially in groups that include adults with lower levels of education and literacy. Therefore, education may need to be considered when applying cutoffs to these populations.

show abstract

Cutoff Elasticity in Multivariate Models of Performance Validity Assessment as a Function of the Number of Components and Aggregation Method

Erdodi

2023

Psychol. Inj. and Law

View full text Add to dashboard Cite

Full of Surprises: Performance Validity Testing in Examinees with Limited English Proficiency

Cited by 4 publications

References 146 publications

Base rates of failure on various performance validity tests as a function of age in adults referred for neuropsychological assessment.

Base rates of failure on various performance validity tests as a function of age in adults referred for neuropsychological assessment.

Measures of performance validity for Hispanic/Latin American adults: A PRISMA systematic review.

Cutoff Elasticity in Multivariate Models of Performance Validity Assessment as a Function of the Number of Components and Aggregation Method

Contact Info

Product

Resources

About