Total grit scale score does not represent perseverance

Abstract

In PNAS, Jachimowicz et al.(1) claim that the results from a three-study investigation show that passion moderates the perseverance-performance relationship such that the relationship is stronger when passion is high. Their metaanalysis (study 1) is characterized by a series of questionable decisions and coding errors, but my primary concern is that the findings of all three studies are based on a statistical error. Because of space limitations, I focus this letter only on this primary concern.The two grit scales (2, 3) were developed to measure two aspects of grit: perseverance ("perseverance of effort") and passion ("consistency of interests"). While some researchers use an aggregate score to represent overall grit, others use separate scores for perseverance and passion in their analyses, in line with recent metaanalytic evidence (4) indicating that this is more appropriate. Jachimowicz et al. (1) base the results in all three studies on the highly unorthodox assumption that the total score on the grit scale (i.e., perseverance and passion combined) can be used to represent just perseverance. I am unware of anyone else who has interpreted the total grit scale in this manner, probably because half of the items clearly measure passion rather than perseverance. The authors indicated to me that they based their decision on confirmatory factor analyses of the responses to the total grit scale. Specifically, the authors state that a single-factor model exhibited much worse fit than a higher-order model with two first-order factors and one-second order factor (and an equality constraint). This justification reflects a misunderstanding of factor analysis because the higher-order model, as specified, is mathematically identical to the two-factor model that reflects the hypothetical structure of the scales, with perseverance and passion as separate factors. In other words, the authors' own analyses confirm that the scale responses have a clear two-factor solution, not a one-factor solution. As such, their use of the overall grit score to represent just perseverance is incorrect in two ways: (i) the scale exhibits a clear twodimensional structure, and (ii) the overall score would be combination of perseverance and passion.If this error is corrected, then study 1 has little meaning since all of the effect sizes reflect the overall grit score, not perseverance as claimed. Further, in study 3, if perseverance is computed from the items that were intended to measure perseverance, then no moderation effect is evident. That is, perseverance does not interact with passion in predicting performance. The data for study 2 were not publicly available, but it is likely that the claimed moderation effect would be absent for this study too. Development and validation of the short grit scale (grit-s). J Pers Assess 91:166-174. 4 Credé M, Tynan MC, Harms PD (2017) Much ado about grit: A meta-analytic synthesis of the grit literature. J Pers Soc Psychol 113:492-511.

Beyond Passion and Perseverance: Review and Future Research Initiatives on the Science of Grit

“…The study demonstrates that combining perseverance and passion is linked to higher levels of work-related and academic performance. However, recent research has pointed out theoretical and measurement issues on the validity of the total score generated by their scale measuring perseverance of effort and passion, to assess perseverance (Credé, 2019 ).…”

Longitudinal Invariance Analysis of the Short Grit Scale in Chinese Young Adults

“…Criterion-related studies, on the other hand, with Grit-S also have inconsistencies -they either combine the two grit facets to a single grit score or treat the two grit subscales separately (Credé, 2018;Guo et al, 2019). Additionally, recent controversies have focused on how the Grit-S captures only perseverance (PE) without passion (CI) (e.g., Jachimowicz et al, 2018Jachimowicz et al, , 2019Credé, 2019;Guo et al, 2019). Given that prior studies that examined the psychometric properties of the Grit-S preferred the two first-order factors structure to the high-order factor solution (see Table 1), the present study would like to examine the longitudinal properties of the Grit-S within the two lower order factors model.…”

Reply to Guo et al. and Credé: Grit-S scale measures only perseverance, not passion, and its supposed subfactors are merely artifactors

“…In their letters, Guo et al (4) and Credé (5) suggest that the Grit-S scale should be treated as reflecting two factors. Credé (5) subsequently advocates for and Guo et al (4) conducts separate analyses for each supposed subfacet of the Grit-S scale (called "perseverance of effort" and "consistency of interests").…”