Review of effectiveness-evaluation methodologies for safeguards and security systems

Abstract

We discuss the factors that influence the effectiveness of safeguards and security measures and the characteristics required of effectiveness evaluation methodologies. Within this context and from a utility standpoint, we review those effec¬ tiveness evaluation methodologies that have been developed. Our principal recommendation concerns the application and con¬ comitant validation of existing methodologies. This recommen¬ dation derives from our conclusion that there has been a gross imbalance between the effort spent on methodology develop¬ ment and the application of those methodologies. Only for those safeguards measures that do not seem to be covered by existing methodologies or that seem to be inadequately covered do we suggest development. This report presents our conclusions and recommendations resulting from a study, concluded in January 1980, of effectiveness evaluation methodologies for safeguards and security systems. The study' examined evaluation methodologies, either extant or being developed, and assessed the usefulness to the Department of Energy Office of Safeguards and Security (DOE/OSS) of such methodologies for performing an adequate and meaningful system evaluation. This report is structured as follows: first, we provide what we perceive to be factors that influence the effectiveness and effectiveness evaluations of safeguards and security systems; second, we briefly describe the review procedures used in our study; and last, we present our conclusions and recommendations. Appendixes A and B describe the methodologies we examined.