Age and sex invariance of the International Cognitive Ability Resource (ICAR)

Young, Stephanie; Keith, Timothy Z.; Bond, Mark A.

doi:10.1016/j.intell.2019.101399

Cited by 10 publications

(8 citation statements)

References 28 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…It demonstrated convergent validity with the WAIS‐IV (Young & Keith, 2020) as well as the various ability and achievement tests, such as the SAT, ACT, and GRE (Condon & Revelle, 2016). There is also evidence of measurement invariance for age and sex (Young et al, 2019). The ICAR includes four types of items (i.e., letter and number series, matrix reasoning, verbal reasoning, and three‐dimensional rotation), with scores ranging from 0 to 16.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

LinkedIn‐based assessments of applicant personality, cognitive ability, and likelihood of organizational citizenship behaviors: Comparing self‐, other‐, and language‐based automated ratings

Roulin

Stronach

2022

Int J Selection Assessment

View full text Add to dashboard Cite

We compared self‐reports or test‐based assessments of personality, cognitive ability, and likelihood or tendencies to engage in organizational citizenship behaviors (OCB) from experienced workers (targets, N = 154) with one approach to rate these traits based on LinkedIn profiles using hiring professionals (panel raters, N = 200), graduate students in Industrial‐Organizational Psychology (I‐O raters, N = 6), and automated assessments with the language‐based tool Receptiviti (for personality only). We also explored the potential for adverse impact associated with this approach of LinkedIn profile assessments and how profile elements are associated with ratings. Results demonstrated that raters can reliably assess personality, cognitive ability, and OCB with one‐item measures. LinkedIn showed little promise for valid assessments of personality (except some weak evidence for honesty‐humility) and OCB tendencies for all data sources. And, we only found modest evidence of convergent validity for cognitive ability. Automated assessments of personality with Receptiviti were more consistent with raters' assessments than targets' self‐reports. LinkedIn‐based hiring recommendations did also not differ on the basis of gender, race, or age. Finally, in terms of profile content, longer LinkedIn profiles with more professional connections, more skills listed, or including a professional picture were viewed more positively by both types of raters. But these content elements were largely unrelated to targets' self‐reports or test scores. Thus, organizations should be careful when relying on LinkedIn‐based assessments of applicants' traits.

show abstract

Section: Methodsmentioning

confidence: 99%

“…Revelle, 2016). There is also evidence of measurement invariance for age and sex (Young et al, 2019). The ICAR includes four types of items (i.e., letter and number series, matrix reasoning, verbal reasoning, and three-dimensional rotation), with scores ranging from 0 to 16.…”

Section: Automated Assessments Of Personalitymentioning

confidence: 99%

LinkedIn‐based assessments of applicant personality, cognitive ability, and likelihood of organizational citizenship behaviors: Comparing self‐, other‐, and language‐based automated ratings

Roulin

Stronach

2022

Int J Selection Assessment

View full text Add to dashboard Cite

show abstract

“…The ICAR generally showed satisfactory psychometric properties (e.g., Condon & Revelle, 2014;Young et al, 2019). Procedure…”

Section: Methods For Discriminant Validitymentioning

confidence: 99%

Analytic and Holistic Cognitive Style as a Set of Independent Manifests: Evidence from a Validation Study of Six Measurement Instruments

Lacko¹,

Prošek²,

Čeněk³

et al. 2021

Preprint

View full text Add to dashboard Cite

Cognitive styles are commonly studied constructs in cognitive psychology. It can be argued that measurement of these styles in the past had significant shortcomings in validity and reliability. The theory of analytic and holistic cognitive styles followed from traditional research of cognitive styles and attempted to overcome these shortcomings. Unfortunately, the psychometric properties of its measurement methods in many cases were debatable or not reported. New statistical approaches, such as analysis of reaction times, have been reported in the recent literature but remain overlooked by current research on analytic and holistic cognitive styles. The aim of this pre-registered study was to verify the psychometric properties (i.e., factor structure, split-half reliability, test-retest reliability, discriminant validity with intelligence and personality, and divergent, concurrent and predictive validity) of several methods routinely applied in the field. We developed/adapted six methods, and selected several types frequently applied in cognitive style research: self-report questionnaires, methods based on rod-and-frame test principles, embedded figures, and methods based on hierarchical figures. The analysis was conducted on 392 Czech participants, with two data collection waves. The results indicate that the use of self-report questionnaires and methods based on the rod-and-frame principle may be unreliable, demonstrating unsatisfactory factor structure and no absence of association with intelligence. The use of embedded and hierarchical figures is recommended. Because the concurrent and divergent validity of the methods did not correspond with the original two-dimensional theory, we formulated a new three-level hierarchical model of analytic and holistic cognitive styles which better described our empirical findings.

show abstract

“…Although data are cross-sectional, in this project, we wanted to examine whether there were yearly trends in temperament and cognitive ability across age, gender, education, and geographic origin from 2006 to 2018. Recent findings indicated that a subset of the ability items used in the SAPA-Project were slightly biased toward men across all domains (Young, Keith, & Bond, 2019). Furthermore, age showed a positive curvilinear effect for all domains but verbal reasoning.…”

Section: A Workhop-based Graduate Course On Preregistrationmentioning

confidence: 99%

Bringing the (pre)registration revolution to graduate training.

Tackett¹,

Brandes²,

Dworak³

et al. 2020

Canadian Psychology / Psychologie canadienne

View full text Add to dashboard Cite

Preregistration, which involves documentation of hypotheses, methods, and plans for data analysis prior to data collection or analysis, has been lauded as 1 potential solution to the replication crisis in psychological science. Yet, many researchers have been slow to adopt preregistration, and the next generation of researchers is offered little formalized instruction in creating comprehensive preregistrations. In this article, we describe a collaborative workshop-based preregistration course designed and taught by Jennifer L. Tackett. We provide a brief overview of preregistration, including resources available, common concerns with preregistration, and responses to these concerns. We then describe the goals, structure, and evolution of our preregistration course and provide examples of enrolled students' final research products. We conclude with reflections on the strengths and opportunities for growth for the 1st iteration of this course and suggestions for others who are interested in implementing similar open science-focused courses in their training programs. Public Significance StatementPreregistration-or the public posting of plans for a study prior to its completion-is a tool that shows great promise for increasing scientific rigor. However, this practice has not yet been adopted by the majority of psychology researchers. In this article, the authors detail their approach to creating a workshop-based class on preregistration that makes preregistration accessible to multiple areas of psychology.

show abstract

Age and sex invariance of the International Cognitive Ability Resource (ICAR)

Cited by 10 publications

References 28 publications

LinkedIn‐based assessments of applicant personality, cognitive ability, and likelihood of organizational citizenship behaviors: Comparing self‐, other‐, and language‐based automated ratings

LinkedIn‐based assessments of applicant personality, cognitive ability, and likelihood of organizational citizenship behaviors: Comparing self‐, other‐, and language‐based automated ratings

Analytic and Holistic Cognitive Style as a Set of Independent Manifests: Evidence from a Validation Study of Six Measurement Instruments

Bringing the (pre)registration revolution to graduate training.

Contact Info

Product

Resources

About