Measureing the Performance of Experts: An Application to Air Traffic Control

Thomas, Rick P.; Willems, Ben; Shanteau, James; Raacke, John; Friel, Brian

doi:10.1177/154193120104500404

Cited by 5 publications

(5 citation statements)

References 4 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The CWS has successfully been used to discriminate between expert and novice doctors, auditors, livestock judges, personnel selectors (Shanteau, Weiss, Weiss & Shanteau, 2003), and air traffic controllers Thomas, Willem, Shanteau, Raacke, & Friel, 2001, 2002. For example, created air traffic control scenarios whereby the complexity (number of aircraft in the sector) of the scenarios was manipulated.…”

mentioning

confidence: 99%

Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index

Pauley

O'Hare

Wiggins

2009

The International Journal of Aviation Psychology

View full text Add to dashboard Cite

Two studies were conducted to measure expertise in aeronautical weather-related risk perception using the Cochran-Weiss-Shanteau (CWS) index. In the first study, qualified pilots, student pilots, and geography students were presented with weather-related scenarios, and rated the risk involved in each scenario. There was no relationship between flight experience and the CWS scores. The 3 groups of participants did not significantly differ in their CWS scores, although the qualified pilots were the most discriminating, and the geography students were the most consistent. To decrease reliance on memory, the CWS procedure was modified to involve a blocking task and a second study was carried out with qualified pilots. In contrast to Study 1, there was a relationship between flight experience and the CWS scores, suggesting that the adapted CWS procedure was a more valid measure of expertise in weather-related risk perception than the CWS task used in Study 1. The CWS procedure could be a useful tool in assessing expertise in aeronautical judgment and decision making.

show abstract

mentioning

confidence: 99%

Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index

Pauley

O'Hare

Wiggins

2009

The International Journal of Aviation Psychology

View full text Add to dashboard Cite

show abstract

“…In a study unrelated to healthcare, the performance of air traffic controllers managing their airspace was assessed. Researchers identified that a larger CWS index score was associated with better air traffic control performance and outcomes (Thomas et al., 2001). Whilst different professions and markedly different contexts for making judgements, greater discrimination between clinical cues and better internal consistency with prescribing decisions may be important factors for generating better patient outcomes.…”

Section: Discussionmentioning

confidence: 99%

Prescribing hand strengthening exercise for patients with rheumatoid arthritis; clinical cues influencing occupational therapists' and physiotherapists' judgements

Boniface,

White,

Tomlinson

et al. 2023

Musculoskeletal Care

View full text Add to dashboard Cite

ObjectiveTo explore the clinical judgements of therapists in prescribing the intensity of hand strengthening exercise in rheumatoid arthritis (RA).MethodsPhase I: Eleven therapists knowledgeable in treating patients with RA subjectively identified seven clinical cues. These were incorporated into 54 hypothetical patient case scenarios. Phase II: Therapists with ≥2 years post‐registration experience and current or recent experience in treating patients with RA were asked to assess 69 case scenarios in total (54 + 15 repeats) and judge what intensity of hand strengthening exercise they would prescribe using the OMNI‐Resistance Exercise Scale of perceived exertion. Using responses to the repeated cases, the Cochran‐Weiss‐Shanteau index of expertise was used to identify therapists who prescribed more consistently. Multiple regression was used to determine which clinical cues were most strongly associated with the intensity of exercise prescribed. A sub‐group analysis explored differences between consistent and inconsistent prescribers.ResultsFifty‐three therapists took part. Thirty completed all 69 case scenarios. Across all therapists, the three most important clinical cues associated with lower intensity of exercise prescribed were (1) Patient's reported pain intensity whilst practising the exercise (β = −1.150, p < 0.001), (2) Disease activity (β = −0.425, p < 0.001) and (3) average hand pain over the last week (β = −0.353 p < 0.001). Twelve therapists were categorised as consistent prescribers. This group relied on fewer clinical cues (three vs. seven) when judging what intensity of exercise to prescribe.ConclusionThis study provides insights into how therapists prescribe hand exercises. Intensity of hand strengthening exercise was influenced by three key clinical cues, including pain intensity and disease activity.

show abstract

“…The CWS has also been applied to a longitudinal study tracking the acquisition of competence in air traffic control (Thomas et al 2001). The CWS scores in this study were found to reflect gradual performance improvements as operators gained experience.…”

Section: Application Of the Cwsmentioning

confidence: 91%

Factors associated with the Acquisition of Expertise in Upper Limb Hypertonicity Management

Burgess

Rassafiani

Copley

2008

British Journal of Occupational Therapy

View full text Add to dashboard Cite

Issues in the management of upper limb hypertonicity Hypertonicity can be defined as increased resistance of the limbs to passive movement, which is often associated with neurological conditions such as stroke and cerebral palsy. It results from spasticity (hyperactivity of the stretch reflex) and /or changes in the characteristics of the muscular and connective tissues (Gordon 1990, Levin and Hui-Chan 1993, Umphred 2001). Other performance component impairments of the hand and arm resulting from these conditions may include sensory impairments, reduced muscle length, weakness or paralysis, changes in patterns of muscle recruitment, and disuse (Denislic and Meh 1995, Corry et al 1997, Boyd et al 2001, Fehlings et al 2001, Zackowski et al 2004). Combinations of these impairments contribute to difficulties in reaching, grasping, releasing and manipulating objects (Boyd et al 2001). The literature in this area continues to reflect ongoing debate regarding the underlying mechanisms of upper limb dysfunction in the presence of hypertonicity, with treatment approaches guided by contrasting theories (Copley and Kuipers 1999, Mortenson and Eng 2003). Upper limb hypertonicity management is a complex domain, in which there is limited high level evidence to support treatment approaches. Therefore, it is important to identify clinical experts to assist practice development. This study aimed to investigate the relationship between the factors related to clinical experience and the development of expertise in this area. Through correspondence, 29 therapists were asked to choose the most appropriate intervention for 60 case vignettes. The responses were examined using the Cochran-Weiss-Shanteau Index of Performance, and were analysed in regard to therapists' ability to prescribe differing interventions based on differences in the vignettes and on their consistency when vignettes were unknowingly repeated. The number of professional development activities that the therapists had undertaken since attaining occupational therapy qualifications was the only factor significantly associated with increased levels of expertise. The factors not significantly associated with increased expertise included therapists' work setting, years of experience and current proportion of caseload comprising hypertonicity. The results indicated that expertise gained in the area of hypertonicity was not specific to clients' age or condition because, although all vignettes presented were those of children with cerebral palsy, there was no significant difference in the expertise found between paediatric and adult therapists. Further research is warranted to investigate the forms of professional development that best support the development of expertise in this area.

show abstract

Measureing the Performance of Experts: An Application to Air Traffic Control

Cited by 5 publications

References 4 publications

Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index

Measuring Expertise in Weather-Related Aeronautical Risk Perception: The Validity of the Cochran–Weiss–Shanteau (CWS) Index

Prescribing hand strengthening exercise for patients with rheumatoid arthritis; clinical cues influencing occupational therapists' and physiotherapists' judgements

Factors associated with the Acquisition of Expertise in Upper Limb Hypertonicity Management

Contact Info

Product

Resources

About