Development and Preliminary Reliability of a Multitasking Assessment for Executive Functioning After Concussion

Abstract

MeSH TERMSbrain concussion executive function military personnel reproducibility of results task performance and analysis OBJECTIVES. Executive functioning deficits may result from concussion. The Charge of Quarters (CQ) Duty Task is a multitask assessment designed to assess executive functioning in servicemembers after concussion. In this article, we discuss the rationale and process used in the development of the CQ Duty Task and present pilot data from the preliminary evaluation of interrater reliability (IRR).METHOD. Three evaluators observed as 12 healthy participants performed the CQ Duty Task and measured performance using various metrics. Intraclass correlation coefficient (ICC) quantified IRR.RESULTS. The ICC for task completion was .94. ICCs for other assessment metrics were variable.CONCLUSION. Preliminary IRR data for the CQ Duty Task are encouraging, but further investigation is needed to improve IRR in some domains. Lessons learned in the development of the CQ Duty Task could benefit future test development efforts with populations other than the military.

Further Development of the Assessment of Military Multitasking Performance: Iterative Reliability Testing

“…Rehabilitation assessments that involve multisystem performance often require a multistep process of development and refinement in order to establish IRR [9–11, 14, 15, 17, 18]. Acceptable levels of IRR were achieved for the AMMP dual-task and multitask metrics with the application of a deliberate refinement process that recognized the importance of measure reliability and feasibility.…”

“…During Phase Ia, we evaluated the feasibility and IRR of the original 9 tasks comprising the original version of the AMMP [4, 5]. Three of the original 5 multitasks were eliminated [14] and salient components were refined and consolidated into one multitask called the Charge of Quarters (CQ) Duty Task (Fig 1). The 3 original multitasks demonstrated poor IRR due to unclear operational definitions of success and failure on task components, and difficulty observing all components of each task.…”

Toward Return to Duty Decision-Making After Military Mild Traumatic Brain Injury: Preliminary Validation of the Charge of Quarters Duty Test

“…Keeler St., Suite B, Olathe, KS 66062), reporting information to a supervisor at various times, and inventorying supplies. 24 Participants are also told to adhere to task rules and complete the assignments making as few visits as possible to the four work stations, designated with signage and masking taped boundaries (Fig. 2).…”

Occupational Therapy for Servicemember and Veteran Recovery, Resilience, and Reintegration: Opportunities for Societal Contribution and Professional Transformation

“…Tomar and Stoffel (2014) elucidate the experience of veterans who assume student roles. Speicher, Walter, and Chard (2014) describe occupational performance outcomes of a residential treatment program for PTSD and traumatic brain injury, and Smith et al (2014) provide a preliminary report on the development of a multitasking assessment to inform readiness for duty after concussion. Finally, Cogan (2014) articulates the needs of military families and an expanded role for occupational therapy in mental health care.…”