Using a bare-bones meta-analysis, the present study examined the effectiveness of the use of commonly considered alternative predictor methods as a means to reduce subgroup differences (i.e., the method-change approach), taking into account the constructs assessed. With a focus on assessment centers, interviews, situational judgment tests, and work samples as alternative methods, the results indicated that consonant with the construct/method distinction, the effectiveness of a method in reducing subgroup differences is a function of the constructs assessed. Specifically, there are larger White-African American subgroup differences that favor Whites for cognitive constructs on paper-and-pencil tests compared to the alternative methods; and most notably, the opposite result was obtained for noncognitive constructs such that, compared to paper-and-pencil assessments, substantially larger White-African American subgroup differences were observed for alternative methods. A similar pattern of results was obtained for White-Hispanic comparisons, albeit based on a smaller number of data points. In summary, the study's results indicate that the ubiquitously asserted effectiveness of the method-change approach for reducing subgroup differences is overstated, with said effectiveness depending on the construct assessed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.