This study examined the effectiveness of the after-action review (AAR)-also commonly termed debrief-and 4 training characteristics within the context of Villado and Arthur's (2013) conceptual framework. Based on a bare-bones meta-analysis of the results from 61 studies (107 ds [915 teams and 3,499 individuals]), the AAR leads to an overall d of 0.79 improvement in multiple training evaluation criteria. This effect is larger than some of the largest training method effects reported in Arthur, Bennett, Edens, and Bell (2003), and it is also larger than Tannenbaum and Cerasoli's (2013) estimate of the effect of the AAR on task performance (d ϭ 0.67). Two training characteristics consistently contributed to the effectiveness of the AAR: (a) alignment to the individual or the team, and (b) objective performance review media. The effects of the other training characteristics were often interactive. Most notably, the facilitation approach contributes to the effectiveness of the AAR in combination with the individual versus the team and the type of review media, with the most effective combinations being the self-led facilitation approach coupled with a team-aligned AAR, and the self-led approach coupled with objective media. Additionally, the AAR that is highly structured is more effective than a less structured AAR in the military, but high and low structured AARs display comparable effectiveness in healthcare. Overall, this study suggests that the effectiveness of the AAR should be understood as a function of the combined influence among multiple interacting characteristics. Future theoretical development and research should be directed at better understanding these interactions.
Using a bare-bones meta-analysis, the present study examined the effectiveness of the use of commonly considered alternative predictor methods as a means to reduce subgroup differences (i.e., the method-change approach), taking into account the constructs assessed. With a focus on assessment centers, interviews, situational judgment tests, and work samples as alternative methods, the results indicated that consonant with the construct/method distinction, the effectiveness of a method in reducing subgroup differences is a function of the constructs assessed. Specifically, there are larger White-African American subgroup differences that favor Whites for cognitive constructs on paper-and-pencil tests compared to the alternative methods; and most notably, the opposite result was obtained for noncognitive constructs such that, compared to paper-and-pencil assessments, substantially larger White-African American subgroup differences were observed for alternative methods. A similar pattern of results was obtained for White-Hispanic comparisons, albeit based on a smaller number of data points. In summary, the study's results indicate that the ubiquitously asserted effectiveness of the method-change approach for reducing subgroup differences is overstated, with said effectiveness depending on the construct assessed.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.