Empirical Keying of Biographical Data: Cross-Validity as a Function of Scaling Procedure and Sample Size

Devlin, Steven; Abrahams, Norman M.; Edwards, Jack

doi:10.1207/s15327876mp0403_1

Cited by 17 publications

(23 citation statements)

References 13 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In the only published direct comparison of alternative biodata keying procedures (Devlin, Abrahams, & Edwards, 1992), response option-based scoring yielded the highest criterion validities. A similar scoring method that generates weights approximating point biserial correlations, but requiring substantially less computational resources, is known as the ''vertical percent difference'' method.…”

Section: Methodsmentioning

confidence: 99%

“…The r pb is a special case of the Pearson product-moment correlation (r) applicable when correlating a truly dichotomous variable (e.g., response options either chosen or not) with a continuous variable (e.g., a performance measure) and is the most efficient means (i.e., best linear unbiased estimator) of capturing the strength of the relationship between an item response option and the criterion of interest. In the only published direct comparison of alternative biodata keying procedures (Devlin, Abrahams, & Edwards, 1992), response option-based scoring yielded the highest criterion validities. A similar scoring method that generates weights approximating point biserial correlations, but requiring substantially less computational resources, is known as the ''vertical percent difference'' method.…”

Section: Methodsmentioning

confidence: 99%

See 1 more Smart Citation

An Examination of Biodata Theory‐Based Constructs in a Field Context

Dean¹,

Russell

2005

Int J Selection Assessment

View full text Add to dashboard Cite

This study examined whether items from a biodata inventory were consistent with theorybased constructs as suggested by the ecology model. The model posits five constructs explain biodata predictive ability. Items were sorted using the theory-based construct domains. The resulting scale scores were assessed for evidence of content, criterionrelated, and construct validity in a sample of 6032 automated systems controllers. Results suggested moderate support for the theory-based constructs. A notable finding was that items capturing a theoretical construct were impacted by the life stage in which they were anchored. Results further suggest the need to examine if certain life stages are more predictive than others or perhaps if certain constructs are more predictive when related to a particular life stage.

show abstract

Section: Methodsmentioning

confidence: 99%

Section: Methodsmentioning

confidence: 99%

An Examination of Biodata Theory‐Based Constructs in a Field Context

Dean¹,

Russell

2005

Int J Selection Assessment

View full text Add to dashboard Cite

show abstract

“…Empirical keys are scored based on each item's ability to discriminate between good and poor performers on a criterion of interest in a key development sample (Mumford & Owens, 1987). Empirical keys are then cross-validated to guard against capitalizing on random chance variations in the sample upon which a key is developed (for a number of variations on possible empirical keying techniques, see Devlin, Abrahams, & Edwards, 1992). Alternatively, rational scoring involves having subject matter experts weight the different response alternatives of each item.…”

mentioning

confidence: 99%

Examination of ethnic group differential responding on a biodata instrument

Dean¹

2013

J Applied Social Pyschol

View full text Add to dashboard Cite

Biodata is a selection device that is often cited for high criterion validity and low adverse impact, yet little research examines the latter point. Further, little is known about whether differential biodata item responding by ethnic group occurs, and if so, whether this impacts ethnic group differences, predictive bias, adverse impact, and criterion validity. Data from 5,242 applicants for a government agency position indicated that elimination of biodata item response options with differential ethnic group selection rates from scoring consideration resulted in a large decrease in ethnic group differences, no predictive bias, less potential adverse impact, and a nonsignificant decrease in criterion validity. Results are compared to a general mental ability measure. Implications and future research directions are discussed.

show abstract

“…This procedure requires large samples and makes it likely that the weights will be unstable and unable to cross validate (e.g., Devlin et al 1992;Schwab and Oliver, 1974;Webb, 1960).…”

mentioning

confidence: 99%

“…A final problem is the cumbersomeness of the item analysis and item scoring procedures, with each item alternative being analyzed separately and assigned its own one-or two-digit scoring weight (e.g., England, 1971). This procedure requires large samples and makes it likely that the weights will be unstable and unable to cross validate (e.g., Devlin et al 1992;Schwab and Oliver, 1974;Webb, 1960).…”

mentioning

confidence: 99%

Assessing Leadership Potential with a Biographical Measure of Personality Traits

Stricker

Rock

1998

Int J Selection Assessment

View full text Add to dashboard Cite

The aim of this study was to demonstrate the feasibility of biographical inventories free of the limitations common to many current biographical measures by constructing and validating an inventory composed of homogeneous scales, with item content that is factual and fair, to assess personality traits predictive of leadership. The experimental inventory, with tentative scales for Dominance, Emotional Stability, Need for Achievement, Self-Confidence, and Sociability, was administered to incoming midshipmen at the US Naval Academy and item analyzed. The validity of the final scales was appraised against subsequent peer ratings of the traits and of leadership shortly after entering the Academy; military performance grades, and midshipman rank and leadership position at the Academy; and recommendations for promotion after graduating and serving as an officer. The Sociability, Dominance, and Need for Achievement scales demonstrated convergent and discriminant validity, and all of the scales except Self-Confidence correlated with the leadership criteria. The Sociability scale's consistent correlations with several of the leadership criteria, including a nontrivial correlation (r = 0.28) with the leadership peer rating, implies that this measure may be useful in assessing leadership potential.

show abstract

Empirical Keying of Biographical Data: Cross-Validity as a Function of Scaling Procedure and Sample Size

Cited by 17 publications

References 13 publications

An Examination of Biodata Theory‐Based Constructs in a Field Context

An Examination of Biodata Theory‐Based Constructs in a Field Context

Examination of ethnic group differential responding on a biodata instrument

Assessing Leadership Potential with a Biographical Measure of Personality Traits

Contact Info

Product

Resources

About