896 19 037 IDA Memorandum M-496 is a related document which provides a comprehensive, annotated bibliography of the reference material acquired in the course of this work. IDA Memorandum M-513, another related document, is a collection of the papers provided by leading experts in testing and evaluation tech-* nology preparatory to an IDA workshop held in support of this work.The authors gratefully acknoledge the support given by all those who participated in the workshop and reviewed this paper. The insights and experience these people so willingly shared has been invaluable. In particular, special thanks go to the following people: IntroductionTesting and uvaluation are recognized as pivotal problems in the development of the Strategic Defense System (SDS). Consequently, a development approach combining design, prototyping, and simulation is being used to allow early evaluation of system requirements and designs. Loosely-coupled, decentralized system architectures are being examined for their facility to reduce the testing problem to a manageable level. But what testing and evaluation technology shall be used to ensure the reliability of, and provide the necessary level of confidence in, SDS software? The purpose of this report is to address this question. *For the past decade, software testing and evaluation have been relatively unpopular subjects. Why this happened is less important than its consequences. It has been a contributing factor to the lag between the state-of-the-art and state-of-the-practice, which is the largest of any in the diverse areas of software engineering, and has resulted in a shortage of research and development (R&D) resources and a small, weak research community. Since SDS prototype software is already being developed, software testing and evaluation are now critical concerns. The Strategic Defense Initiative Organization (SDIO) cannot * wait for testing and evaluation issues to pop up later in the development process (a traditional approach which has proven costly in the past), but must meet the challenge up front.Once the importance of this challenge is recognized, appropriate actions can be taken. There is a substantial body of testing and evaluation technology whose use in an industrial environment is ready to be investigated, preparatory to transitioning the technology into practice. The main body of this report * describes the current status of different areas of this technology. It also outlines a number of tasks for bringing promising elements of the technology into practice. While the use of advanced technology will certainly help, it is by no means sufficient to resolve all testing and evaluation problems. In particular, technology for the testing and evaluation of large, distributed and real-time software systems is still in its infancy. The final part of this report, therefore, recommends a number of tasks to extend the boundaries of technology to meet SDS needs.Testing and evaluation technology is not, by itself, enough to ensure improved practices. Policy must evolve ...
IDA Le it,. N UNo" DEFINMTONS IDA peblis hes be elowiu docMUmet to report Oe recaul af its Work. Reports Reports wre the most aubaltnratlve mod mast carefully considered products IDA publishes. They marmaly embody resilla ot major proejcts which (a) kav a direct hearing en declisios affecting mawo ptograms, (b) address Ismus af significant concern to the Executive Breach, IM Congress and/or the public, or IQ) address issues that hae" "signfiant ecanemic Implications. IDA Raperts are reviewed by outside panels of experts to ensure their Mo"igqulty aod retmuce to lbe problem studied, and May are released bybte President af IDA. Group Reports Group Reports record bhe findings med results at IDA established working groups and panels composed at senior Inihualks addressing major isses which Maervise wevid he be subject at on IDA Raport. MDA roup Reports are reviewed by bea sealer indludual resp Monil for bhe project and~ ab s on$elected by IDA to esur te air high quality and relevance to bhe problems, studied, usd are released by bhe President af IDA. Papers hPe-rsialso saubofltatlve and carefully considered praod-cts ol IDA, address studies bat are narrower In scope bhan bose coverd in Reports. IDA Papers are reviewed to ensure beat bhey meet be Nog standards expected at reere papers in professiona jouralsh or formal Agency reports. Documenits MDA Documents are used tor bne coewienlece of bhe sponsors or be analysts in) I* record substantive work dones In quick reaction studies. (hI to record bhe proceedings of conlferece and meetlngs. (c) to make wavablhe preliminary 4 tentative results of analyses, (d)to rcord data develped i be core mof an nestigatison,or (e)l tofoard Informaion bat ls essentially sunanlyzed sand unvaluate. The review of IDA Doconumnts is tulked to bheir content and Mantlevandas. SThe work reported hIn ths document was conducted under conokac UADA OU N C OW for be Department ot Defense. The publication ot this IDA document does not indicate endorsement by bhe Department at Dftense. mar should bhe contents he construed as reletng be official poiti of OiWe Agency. r© Cg InstItu....e for Defasme Analse IThe Government ofthbe Vafttd Statas Is granted an unlimited licens to reproduce this document.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.