Scoring Situational Judgment Tests Using Profile Similarity Metrics

Legree, Peter J.; Kilcullen, Robert N.; Psotka, Joseph; Putka, Dan J.; Ginter, Ryan N.

doi:10.21236/ada530091

Cited by 9 publications

(8 citation statements)

References 13 publications

(16 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Ability was scored using PSM (Legree et al, 2010, 2014). We use two scores: The first is elevation , the absolute difference between an average participant’s response across all relevant items and the average of the optimal profile.…”

Section: Studymentioning

confidence: 99%

The “g” in Faking: Doublethink the Validity of Personality Self-Report Measures for Applicant Selection

Geiger¹,

Olderbak²,

Sauter³

et al. 2018

Front. Psychol.

View full text Add to dashboard Cite

The meta-analytic finding that faking does not affect the criterion validity of self-report measures in applicant selection suggests cognitive abilities are crucial to fake personality to an expected optimal profile in self-report measures. Previous studies in this field typically focus on how the extent of faking changes self-report measurement. However, the effect of faking ability is rarely considered. In Study 1 (n = 151), we link two questionnaires, the WSQ and the NEO-PI-R, to use them for later faking ability tasks. With O∗NET expert ratings and the linked questionnaires, we establish veridical responses of optimal personality profiles for both questionnaires. Based on this, in Study 2, we develop six faking ability task employing both questionnaires and three common jobs to fake for. To score the tasks, we introduce profile similarity metrics that compare faked response vectors to optimal profile vectors. The faking ability tasks were administered to a community sample (n = 210) who additionally completed measures of cognitive abilities, namely general mental ability, crystallized intelligence, and interpersonal abilities. For all, based on previous research, it can be argued that they should predict individual differences in faking ability. We establish a measurement model of faking ability and its relation to the other cognitive abilities. Using structural equations modeling, we find the strongest effect for crystallized intelligence and weaker effects for general mental ability and interpersonal abilities, all positively predicting faking ability. We show for the first time that we can measure faking ability with psychometrically sound techniques, establish a confirmatory factor model of faking ability and that it is largely explained by other cognitive abilities. We conclude that research supporting a positive link between self-reported personality and job performance is presumably confounded by cognitive abilities, because they are predictive of both faking self-reported personality and job performance. We recommend researchers to broaden their measurements with assessments of faking ability or other cognitive abilities (besides general mental ability) in research regarding applicant selection.

show abstract

Section: Studymentioning

confidence: 99%

The “g” in Faking: Doublethink the Validity of Personality Self-Report Measures for Applicant Selection

Geiger¹,

Olderbak²,

Sauter³

et al. 2018

Front. Psychol.

View full text Add to dashboard Cite

show abstract

“…Vallejo (2006) indicates that people can change tendencies of automatic response to certain emotional experiences thanks to training in mindfulness, which allows people to respond with other new and more positive behavioral repertoires as a result of quiet reflection. As supported by Holen and Halvor (2007), perhaps the continuous practice of such full consciousness would prepare us against adversity, while reducing tension, fears and worries through the progressive disengagement of thoughts, sensations and emotions. This would thus be a very useful and effective emotional self-regulation mechanism.…”

Section: Introductionmentioning

confidence: 99%

Emotional Intelligence and Mindfulness: Relation and Enhancement in the Classroom With Adolescents

et al. 2018

View full text Add to dashboard Cite

Emotional intelligence (EI) and mindfulness are two constructs that have been separately studied, and the relation between them still remains unclear. Research in this area has not attempted to go further into how enhancing EI and mindfulness together can achieve better improvements in this ability to attend mindfully. To bridge this knowledge gap, our research goal was to study the relationship between EI and the mindfulness competence in our study sample and to assess the impact of implementing EI and a mindfulness competence developmental program (SEA) about participants’ mindfulness competence. The sample consisted of 156 students aged 11–14 years old from a Spanish public high school. One hundred and eight participants were randomly assigned to the experimental condition, and the remaining 48 were to the control condition. The instruments used to evaluate EI were the CDE-SEC, EQi-Youth Version and the General Empathy Scale. Mindfulness on the School Scope Scale was used to assess mindfulness competences. Social adaptation was evaluated by using the social abilities and adjustment questionnaire BAS3. All the instruments where answered by the participants and have been adapted to a sample of youths with such age specifications. The results showed that EI and mindfulness were related to many of the variables measured by the instruments. Showing a good mindfulness competence was particularly related to having a good general level of the EI trait, and to many of the assessed social and emotional variables. The data indicated a significant relation between the mindfulness competence and having better general empathy skills or being better socially adjusted to the school context. The data also indicated a significant effect on participants’ interior and kinesthetic mindfulness competence after implementing the SEA Program. These findings corroborate the relationship between EI and mindfulness, and the possibility of enhancing mindfulness by applying a direct intervention program in the classroom.

show abstract

“…We again estimated accuracy in psychopathy perception with profile similarity analysis in which we compared the shape of ratings against the shape of the targets’ real scores ( Legree et al 2010 ; Legree et al 2014 ). Ratings of psychopathy were correlated with the targets’ PCL:SV prorated total scores.…”

Section: Studymentioning

confidence: 99%

“…To test whether accuracy in trait perception is related to cognitive abilities, like intelligence, we correlated accuracy scores for the perception of each trait. We estimated accuracy in the perception of intelligence with profile similarity analysis in which we compared the shape of intelligence ratings against the shape of the targets’ BEFKI figural task score real scores ( Legree et al 2010 ; Legree et al 2014 ). On average, the correlations were low, again ranging from strongly negative to strongly positive for individual persons (intelligence: M = 0.06, ranged from −0.61 to 0.63).…”

Section: Studymentioning

confidence: 99%

Detection of Psychopathic Traits in Emotional Faces

Olderbak

Bader²,

Hauser

et al. 2021

J. Intell.

View full text Add to dashboard Cite

When meeting someone at zero acquaintance, we make assumptions about each other that encompass emotional states, personality traits, and even cognitive abilities. Evidence suggests individuals can accurately detect psychopathic personality traits in strangers based on short video clips or photographs of faces. We present an in-depth examination of this ability. In two studies, we investigated whether high psychopathy traits are perceivable and whether other traits affect ratings of psychopathic traits in the sense of a halo effect. On the perceiver’s end, we additionally examined how cognitive abilities and personality traits of the responders affect these ratings. In two studies (n1 = 170 community adults from the USA, n2 = 126 students from Australia), participants rated several targets on several characteristics of psychopathy, as well as on attractiveness, masculinity, sympathy, trustworthiness, neuroticism, intelligence, and extraversion. Results show that responders were generally able to detect psychopathy. Responders generally came to a consensus in their ratings, and using profile similarity metrics, we found a weak relation between ratings of psychopathy and the targets’ psychopathy level as determined by the Psychopathy Checklist: Short Version. Trait ratings, though, were influenced by the ratings of other traits like attractiveness. Finally, we found accuracy in the perception of psychopathy was positively related to fluid intelligence but unrelated to emotion perception ability.

show abstract

Scoring Situational Judgment Tests Using Profile Similarity Metrics

Cited by 9 publications

References 13 publications

The “g” in Faking: Doublethink the Validity of Personality Self-Report Measures for Applicant Selection

The “g” in Faking: Doublethink the Validity of Personality Self-Report Measures for Applicant Selection

Emotional Intelligence and Mindfulness: Relation and Enhancement in the Classroom With Adolescents

Detection of Psychopathic Traits in Emotional Faces

Contact Info

Product

Resources

About