The Cognitive Reflection Test (CRT) is thought to correlate with measures of utilitarian moral judgment because it measures system-2 correction of an initial intuitive response. And some theories of moral judgment hold that the same thing often happens when people arrive a utilitarian judgments. We find, however, that CRT-type items (using logic as well as arithmetic) can work just as well when they do not have obvious intuitive answers at predicting utilitarian moral judgment, assessed with self-report questionnaires as well as with hypothetical scenarios, and also at predicting a measure of actively openminded thinking (AOT). Moreover, long response times, as well as high accuracy, also predict moral judgment and other outcomes. The CRT might thus be considered a test of reflection-impulsivity (RI). However, RI is only part of AOT, because RI is concerned only with the amount of thinking, not its direction. Tests of AOT also predict utilitarian moral judgments. Individual differences in AOT and moral judgments are both strongly (negatively) associated with belief that morality comes from God and cannot be understood through thought. The correlation of CRT and utilitarian judgment, when found, is thus likely due to the (imperfect) correlation of AOT and CRT. Intuition in these domains is thus not necessarily something that people overcome through additional thinking, but rather what they rely on when they do not think very much.
This article extends psychological methods and concepts into a domain that is as profoundly consequential as it is poorly understood: intelligence analysis. We report findings from a geopolitical forecasting tournament that assessed the accuracy of more than 150,000 forecasts of 743 participants on 199 events occurring over 2 years. Participants were above average in intelligence and political knowledge relative to the general population. Individual differences in performance emerged, and forecasting skills were surprisingly consistent over time. Key predictors were (a) dispositional variables of cognitive ability, political knowledge, and openmindedness; (b) situational variables of training in probabilistic reasoning and participation in collaborative teams that shared information and discussed rationales (Mellers, Ungar, et al., 2014); and (c) behavioral variables of deliberation time and frequency of belief updating. We developed a profile of the best forecasters; they were better at inductive reasoning, pattern detection, cognitive flexibility, and open-mindedness. They had greater understanding of geopolitics, training in probabilistic reasoning, and opportunities to succeed in cognitively enriched team environments. Last but not least, they viewed forecasting as a skill that required deliberate practice, sustained effort, and constant monitoring of current affairs. A t APA, we understand how challenging it can be for you to stay abreast of the latest and best academic research on psychology.
Disciplines
Finance and Financial Management | Social and Behavioral Sciences
and Houck (2014) report a major effort to automate integrative complexity coding. Judging this effort requires researchers to be more explicit in articulating key methodological assumptions about the coding process and theoretical assumptions about the construct. Unresolved issues include: (1) when, and on what basis, we should attribute divergences between human coders and algorithms to overestimations or underestimations by one or the other approach; and (2) to what extent second-generation algorithms can yield Pareto improvements that reduce errors of both underestimation and overestimation. Further progress in developing natural language processing measures of this cognitive style will require sharper definitions of target constructs: in particular, different types of differentiation (dialectical and elaborative) and integration (hierarchical and flexible) and clearer guidelines for factoring context into assessments.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.