This paper describes how a Cognitive Task Analysis (CTA) was used to jumpstart the exploration of useful design aids to combat data overload in intelligence analysis. During a simulated analysis task, we observed how professional intelligence analysts were vulnerable to making inaccurate statements when they were under time pressure and working in a topic area outside their area of expertise. From these observations, we generated design recommendations and criteria for evaluating the usefulness of any effort aimed at reducing data overload. Then, we used CTA insights to trigger the development of modular design concepts, or "design seeds," that leverage advances in machine processing to address vulnerabilities. Nine design seeds were integrated into a "Visual Narratives" workspace visualization concept. Feedback about the usefulness of the design seeds was obtained during an elicitation session following an animated fly-through, or "Ani-mock," demonstration. BACKGROUNDdynamic, high consequence, socio-technical setting, requires significant expertise, and is supported by This report explains how we used findings from a Cognitive specialized, computerized artifacts. Task Analysis (CTA) to jumpstart the exploration of useful • Intelligence analysis is an instantiation of inferential design aids to combat data overload in intelligence analysis, analysis, which is defined as determining the best Data overload is a fundamental, ubiquitous problem. In explanation for uncertain, often contradictory and intelligence analysis, as in many other domains, the data incomplete data. Inferential analysis uses abductive overload problem is expected to become even more difficult reasoning (Peirce, 1903) in the sense that a due to the explosion of accessible electronic data and conclusion is inherently contestable due to substantial reductions in staff.As intelligence agencies uncertainty, but that experts agree that certain transfer from Cold War paradigms of monitoring a small conclusions have higher warrantthan others. number of adversarial countries to tracking large numbers of • An intelligence analyst is analogous to a supervisory developing "hot spots" and supporting peacekeeping controller, although there are several important operations, analysts are increasingly stepping outside their distinctions. Rather than monitoring an engineered areas of expertise to respond quickly to targeted questions, system, the analyst monitors a mix of technological and human/organizational processes. As a result, the FRAMING THE PROBLEM monitored system adapts based on knowing it is observed, and diagnostic interventions can be The challenge presented to the team was to develop difficult to conduct. In addition, the process data is information visualizations that would help intelligence mostly freeform text rather than parameter data, analysts deal with the avalanche of electronic, textual data that which makes it difficult to alarm setpoint crossings. is available for analysis. Specifically, there was interest in • We defined data overload...
This paper describes the Digital Culture BA degree: an engineering-arts undergraduate curriculum that combines competency-based education (CBE) and knowledge oriented education (KOE) structures and related Pull-Push approaches. The degree has been offered for three years at Arizona State University, has 200 enrolled students and is continuing to grow. The degree embeds nine knowledge-oriented concentrations, each offered by a relevant participating department, within an interdisciplinary CBE context. The CBE part of the degree provides customized access to 40 interdisciplinary digital culture courses from 12 different academic units by connecting these courses through a set of core competencies. Access to courses is not determined by fixed prerequisites but rather by having one of several possible combinations of lower level competencies. This flexible curriculum is attractive to students, promotes integrative collaborative learning that inspires innovation, and prepares the type of engineering-arts experts and complex problem solvers that are currently needed in creative industries. This type of degree also presents several important challenges for educators and administrators. To address these challenges we developed project based assessment approaches, custom web-based software for advising a very diverse student body, as well as online tools for facilitating peer critique and feedback in large creative classrooms.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.