Assessing Professional Competence by Using Occupational Judgment Tests Derived From Job Analysis Questionnaires

Legree, Peter J.; Psotka, Joseph; Bludau, Tiffany; Gray, Dawn

doi:10.21236/ada494988

Cited by 2 publications

(3 citation statements)

References 42 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Results from the last phase of this study showing significant correlation between the CSQ and Inventory SJT scores and the MOE supervisor ratings, supplemented by the regression analysis, and are consistent with previous research that found SJTs to be Police Practice and Research: An International Journal 9 predictive of performance (Hedlund et al, 2006;Legree et al, 2009). These results suggest that problem-solving ability (as measured by the SJTs) plays a role in police officer competency and effectiveness.…”

Section: Resultssupporting

confidence: 89%

See 1 more Smart Citation

A Police Officer’s Tacit Knowledge Inventory (POTKI): establishing construct validity and exploring applications

Taylor

Elison-Bowers

Werth

et al. 2013

Police Practice and Research

View full text Add to dashboard Cite

Research summarizes the construction of a Police Officer's Tacit Knowledge Inventory (Inventory), a situational judgment test comprised of knowledge gained on-the-job by experienced police officers, and examines if it can play a role in the development of expertise. Correlation and regression analysis was done to establish the Inventory's ability to predict post-Academy graduation performance. Results show that Inventory response patterns correlate with Supervisor ratings; and the Inventory responses correctly predict significant differences between novice patrol officers and experienced police officers.

show abstract

Section: Resultssupporting

confidence: 89%

“…Cronbach's alpha reliabilities (better, r = .92, n = 48, p < .05; worse, r = .76, n = 48, p < .05) were acceptable. While the 'n' is small, previous research has shown that scoring rubrics can be reliably computed from a smaller number of experts (Legree, Psotka, Bludeau, & Gray, 2009). Figure 1 shows a sample scenario.…”

Section: Methodsmentioning

confidence: 99%

A Police Officer’s Tacit Knowledge Inventory (POTKI): establishing construct validity and exploring applications

Taylor

Elison-Bowers

Werth

et al. 2013

Police Practice and Research

View full text Add to dashboard Cite

show abstract

“…The first purpose would be to cluster MOS in order to select which to target in criterion-related validation research. The second purpose would be to identify or develop end-of-training criteria that sufficiently support the Army's personnel classification research but require fewer resources to construct and administer [e.g., the occupational judgment tests developed by Legree, Psotka, Bludau, and Gray (2009)]. In the long-term, collecting job analytic ratings on a large sample of MOS would allow the Army to evaluate procedures for generalizing or transporting criterion-related validation evidence obtained from a smaller sample of MOS to a larger one.…”

Section: Collect Data On a Larger Sample Of Mos And Use To Cluster Mosmentioning

confidence: 99%

Prototype Procedures to Describe Army Jobs

Ingerick¹,

Oliver²,

Allen³

et al. 2010

View full text Add to dashboard Cite

Descriptions of Army jobs or Military Occupational Specialties (MOS) provide the foundation for Army personnel management, from entry-level selection and classification to training and performance management. However, existing job analysis approaches used in the Army have a number of limitations. This project represents the first step in a longterm research roadmap intended to address this issue (Campbell et al., 2007). The purpose of this project was to develop and field test a new prototype job analysis approach, customized to the Army, for describing entry-level enlisted jobs. Questionnaires measuring work and worker-oriented domains were developed and administered online to incumbents and supervisors in six MOS (N = 1,390): (a) Infantryman (11B), (b) Armor Crewman (19K), (c) Signal Support Specialist (25U), (d) Light-Wheel Vehicle Mechanic (63B), (e) Military Police (31B), and (f) Motor Transport Operator (88M). The results of the field test demonstrated that the questionnaires evidenced sufficient reliability and validity for describing enlisted jobs and feature a method that could be easily expanded Army-wide and at a reasonable cost. The report concludes with a summary of lessons learned from the field test and discussion of ways in which future research can enhance and extend the prototype approach.

show abstract

Assessing Professional Competence by Using Occupational Judgment Tests Derived From Job Analysis Questionnaires

Cited by 2 publications

References 42 publications

A Police Officer’s Tacit Knowledge Inventory (POTKI): establishing construct validity and exploring applications

A Police Officer’s Tacit Knowledge Inventory (POTKI): establishing construct validity and exploring applications

Prototype Procedures to Describe Army Jobs

Contact Info

Product

Resources

About