The current study reports on the development and validation of the Academic Diligence Task (ADT), designed to assess the tendency to expend effort on academic tasks which are tedious in the moment but valued in the long-term. In this novel online task, students allocate their time between solving simple math problems (framed as beneficial for problem solving skills) and, alternatively, playing Tetris or watching entertaining videos. Using a large sample of high school seniors (N = 921), the ADT demonstrated convergent validity with self-report ratings of Big Five conscientiousness and its facets, self-control and grit, as well as discriminant validity from theoretically unrelated constructs, such as Big Five extraversion, openness, and emotional stability, test anxiety, life satisfaction, and positive and negative affect. The ADT also demonstrated incremental predictive validity for objectively measured GPA, standardized math and reading achievement test scores, high school graduation, and college enrollment, over and beyond demographics and intelligence. Collectively, findings suggest the feasibility of online behavioral measures to assess noncognitive individual differences that predict academic outcomes.
Compared with admissions test scores, why are high school grades better at predicting college graduation? We argue that success in college requires not only cognitive ability but also self-regulatory competencies that are better indexed by high school grades. In a national sample of 47,303 students who applied to college for the 2009/2010 academic year, Study 1 affirmed that high school grades out-predicted test scores for 4-year college graduation. In a convenience sample of 1,622 high school seniors in the Class of 2013, Study 2 revealed that the incremental predictive validity of high school grades for college graduation was explained by composite measures of self-regulation, whereas the incremental predictive validity of test scores was explained by composite measures of cognitive ability.
Schools are an important context for both basic and applied scientific research. Unlike the laboratory, however, the physical and social conditions of schools are not under the exclusive control of scientists. In this article, we liken collecting data in schools to putting on a theatrical production. We begin by describing the large cast of characters whose collaborative efforts make school-based research possible. Next, we address the critics, including the university Institutional Review Board (IRB) and school administrators, whose feedback often improves the final study design. We then turn our attention to set building, stage directions, and rehearsals – key steps in the iterative process of refining study procedures. We end with a discussion of the day of data collection itself and activities that take place after the curtain drops. Throughout, we make recommendations based on our recent experience collecting data at several high schools.
All the world’s a stage~William Shakespeare, As You Like It, 2.7.139
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.