Concept Development for Future Domains: A New Method of Knowledge Elicitation

Shadrick, Scott B.; Lussier, James W.; Hinkle, Robin

doi:10.21236/ada437257

Cited by 14 publications

(7 citation statements)

References 37 publications

(14 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The stand-alone documents were assembled to produce a Development Support Package (DSP). The documents were crafted by analyzing which components of the FLEX method (Shadrick et al, 2005), FLEX-TTP (Topolski et al, 2009), best practices for brainstorming (Isaksen & Gaulin, 2005;Lamm & Trommsdorff, 1973;Graham, 1977;Madsen & Finger, 1978;Street, 1974), and P2P methods (Costanza et al, 2009) could be reasonably employed by Soldiers with no previous KE experience.…”

Section: Development Of Toolsmentioning

confidence: 99%

“…In a previous research effort (Topolski, Leibrecht, Kiser, Kirkley, & Crabb, 2009), the U.S. Army Research Institute (ARI) developed a novel method to structure the TTP development process for new systems that are not yet mature. Based on Shadrick, Lussier, and Hinkle's (2005) flexible method of cognitive task analysis (FLEX), the flexible method for developing TTP (FLEX-TTP) method is an iterative and vignette-driven approach that harnesses knowledge elicitation techniques with groups of military subject matter experts (SMEs). The goal of this research effort was to adapt and expand the FLEX-TTP method to produce a low-overhead toolbox for use by Soldiers in tactical units.…”

Section: Introductionmentioning

confidence: 99%

“…The ARI research unit at Fort Knox, KY, developed the FLEX method (Shadrick et al, 2005) as an iterative interview and vignette-based KE approach for exploring future concepts. Topolski et al (2009) fashioned a specific extension of the FLEX method (FLEX-TTP) for developing TTP for new technologies.…”

Section: Introductionmentioning

confidence: 99%

“…The purpose of this Development Support Package (DSP) is to assist units and Soldiers in generating or revising tactics, techniques and procedures (TTP). The DSP provides a methodical, proven approach to TTP development or revision based upon an existing Flexible Method of Cognitive Task Analysis (FLEX) (Shadrick, Lussier, & Hinkle, 2005) further tested and refined during subsequent research (Topolski, Leibrecht, Kiser, Kirkley, & Crabb, 2009). The method outlined in the DSP is suitable for use by multiple unit types and echelons using various modes of development/revision.…”

Section: Introductionmentioning

confidence: 99%

See 3 more Smart Citations

Soldiers' Toolbox for Developing Tactics, Techniques, and Procedures (TTP)

Topolski¹,

Leibrecht²,

Porter³

et al. 2010

View full text Add to dashboard Cite

This document describes research conducted to create an innovative, Soldier-friendly method for developing tactics, techniques, and procedures (TTP). The approach built on previously developed methodology, blending knowledge elicitation techniques and simulation-based vignettes to produce a flexible set of tools to structure and guide the TTP development process. The resulting toolbox was implemented with Soldiers to obtain feedback and ideas for improving the method. When groups of Soldiers used the toolbox to develop focused TTP, the method proved to work well with a variety of missions and tactical conditions. The clarity and quality of the tools as well as the effectiveness of the method were assessed using multiple measures. The Soldiers rated the effectiveness of the method's various components positively. The quality of the resulting TTP increased across exercises (practice effect) and groups (resulting from toolbox improvements between groups). Lessons learned about various aspects of the methodology are included.

show abstract

Section: Development Of Toolsmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

Section: Introductionmentioning

confidence: 99%

See 2 more Smart Citations

Soldiers' Toolbox for Developing Tactics, Techniques, and Procedures (TTP)

Topolski¹,

Leibrecht²,

Porter³

et al. 2010

View full text Add to dashboard Cite

show abstract

“…In a previous research effort (Topolski, Leibrecht, Kiser, Kirkley, & Crabb, 2009), the ARI Research Unit at Fort Knox, KY developed a novel method to structure the TTP development process. Based on Shadrick, Lussier, and Hinkle's (2005) flexible method of cognitive task analysis (FLEX), the FLEX-TTP method is an iterative and vignette-driven approach that harnesses knowledge elicitation techniques with groups of military subject matter experts (SMEs). The method was refined and proved successful in developing TTP for new technologies.…”

Section: Introductionmentioning

confidence: 99%

Methods and Measures for Communicating Tactics, Techniques, and Procedures

Anderson¹,

Topolski²,

Leibrecht³

et al. 2010

View full text Add to dashboard Cite

This report describes the methods developed and experiments executed to explore the best methods for communicating tactics, techniques, and procedures (TTPs) and measuring Soldiers' understanding of TTPs. It contains sample documentation of the communication methods, measures, training, and vignettes developed for this exploratory research and then packaged in a "TTP Toolbox" for Soldiers. Overall, each of the three modes of communication resulted in superior performance relative to the control condition, indicating the communication methods tested actually increased Soldiers' understanding of TTP. The Written mode of communication appeared to provide greater understanding of TTP; however, Soldiers preferred the Video-Graphic-Written mode. The authors examine alternate explanations for the findings and document lessons learned about TTP communication and measurement methods based on Soldiers' feedback. The report concludes with method recommendations to improve TTP communication and understanding for future research and implementation. A companion Research Product more fully documents the TTP methods in hard copy and electronic format to facilitate the transition of the TTP Toolbox to Army units and organizations.

show abstract

Implementing Cognitive Work Analysis to Support Early Phases of Sociotechnical System Development

Heever,

Oosthuizen

2022

INCOSE International Symp

View full text Add to dashboard Cite

Systems engineering (SE) is applied to bring about complex systems, such as sociotechnical systems (STS), based on stakeholder requirements. Introducing new technology into an existing STS may result in unexpected emergent behaviour when prevailing processes, procedures and information flows are challenged. Due to the complexity associated with emergence, the resultant system may fail to achieve the desired utility fully, or the work system produced may not be desirable. Cognitive work analysis (CWA) provides a framework for analyzing, modelling, and designing STS. This study proposes applying CWA modelling to requirement analysis for new technology introduction as part of a validation workflow in aid of SE. Work domain analysis (WDA), the first step in the CWA framework, is applied to a test case, and the resultant abstraction hierarchy (AH) models are analyzed to evaluate the perceived utility. This article shows how analysts were able to apply the method and uncover possible design emergence. We hope that the methods presented herein will aid more designers in applying CWA as part of the SE life-cycle toward successfully implementing complex STS.

show abstract

Concept Development for Future Domains: A New Method of Knowledge Elicitation

Cited by 14 publications

References 37 publications

Soldiers' Toolbox for Developing Tactics, Techniques, and Procedures (TTP)

Soldiers' Toolbox for Developing Tactics, Techniques, and Procedures (TTP)

Methods and Measures for Communicating Tactics, Techniques, and Procedures

Implementing Cognitive Work Analysis to Support Early Phases of Sociotechnical System Development

Contact Info

Product

Resources

About