Sensitivity of reliability growth models to operational profile errors

A new approach to software reliability modeling is discussed where variables indirectly related with software reliability are used to provide additional information for the modeling process. Previous studies, empirical and theoretical evidences, and results from experiments indicate that there is a strong relationship between software reliability and coverage of program elements required to be exercised by structural testing criteria. This paper develops a binomial type coverage-based software reliability model through the definition of a coverage-based failure rate function. The Binomial software reliability Model Based on Coverage-BMBC-is proposed and discussed. In the BMBC test data between failures is used instead of time as independent variable; the model was assessed with test data from a real application, making use of the following structural testing criteria: all-nodes, all-edges, and potential-uses-a data-flow based family of testing criteria. The results from our experiments have shown that our modeling approach has some advantages over some traditional reliability models and points to a very promising research direction in software reliability.

show abstract

“…Application of the BMBC is shown using data from an experiment conducted by Crespo et al (1996) at the research center ENEA, Rome, Italy.…”

Section: An Example Of Application Of the Bmbcmentioning

confidence: 99%

A binomial software reliability model based on coverage of structural testing criteria

et al. 2007

View full text Add to dashboard Cite

show abstract

“…Além disso, um perfil operacional pode ser alterado durante o processo de manutenção do software. Todas essas causas podem conduzir a erros na estimação do perfil operacional que afetam a sensibilidade dos modelos de crescimento de confiabilidade, [16]. Os modelos baseados no domlnio do tempo nio consideram a estratégia de teste utilizada.…”

Section: 2-limitações Dos Modelos E Necessidade De Melhoriasunclassified

Cobertura dos Critérios Potenciais-Usos e a Confiabilidade do Software

Crespo

Pasquini²,

Jino

et al. 1997

Anais Do XI Simpósio Brasileiro De Engenharia De Software (SBES 1997)

View full text Add to dashboard Cite

O objetivo principal deste artigo é apresentar os resultados de um experimento realizado para se investigar a relação entre a cobertura do código e a confiabilidade do software. Outras relações também foram investigadas: cobertura do código e dados de teste, cobertura do código e defeitos removidos, confiabilidade do software e defeitos removidos e finalmente confiabilidade do software e dados de teste. O experimento foi realizado para se investigar essas relações, aplicando-se a familia de critérios de teste estruturais Potenciais-Usos. Os dados de teste foram gerados aleatoriamente, condicionados ao perfil operacional do usuário. A cobertura dos elementos requeridos dos critérios foi calculada utilizando-se a ferramenta de teste POKETOOL e a confiabilidade do software foi estimada utilizando-se um algoritmo específico. Estes resultados mostram-nos que pode valer a pena investigar o uso de informação sobre cobertura de elementos requeridos nos modelos de crescimento de confiabilidade de software.

show abstract

“…Applicable software systems are constrained by the following conditions: ( 1) operational profile for the software is identifiable; ( 2 ) critical operations constitute only a small part of the operational profile; and (3) failures of critical operations are the major threat to system dependability. In addition to these limitations, we would like to point out that by our experience, a dependability assessment that is accurate to the right order of magnitude (e.g., an availability of five 9's, regardless of 0.999992 or 0.999998) is more practical and reasonable than an assessment that claims to represent the exact actual dependability.…”

Section: Introductionmentioning

confidence: 99%

An approach to measuring and assessing dependability for critical software systems

Tang

Hecht²

Proceedings the Eighth International Symposium on Software Reliability Engineering

View full text Add to dashboard Cite

Traditional software testing methods combined krsith probabilistic models cannot nieasure arid assess dependability for software that requires v e n high reliabilio (failure rate < 10-'/hour) and availabilit?. (>0. 999999). This paper proposes a novel approach, drawing on findings and methods that have been described individriull~ hut have never been combined, applied in the late testing phase or early operational phase, to quantifi depetitlubility for U categon of critical sofhvare with such high requirenietits. The concepts that are integrated ure: operational profle, rare conditions, importance sampling, stress testing, and measurement-based dependabilir). evaluation. In the approach, importance sanipling is applied on the operational profile to guide the testing of critical operations of the software, thereby accelerating the occurrence of rare conditions which have been shown to be a leading cause of failure in critical systems. The failure rates measured in the testing are then transformed to those that would occur in the normal operation by the likelihood ratio function of the importance sanipling theory, and finally depetidabilih for the tested software system is evaluated by using measurement-based dependabilio modeling techniques. When the acceleration factor is large (over loo), which is r)pical for a category of software of interest, it is possible to quantib a very high reliability or availability in a reasonable test duration. Some feasible methods to inipletnent the approach are discussed based on real data.

show abstract

Sensitivity of reliability growth models to operational profile errors

Cited by 14 publications

References 14 publications

A binomial software reliability model based on coverage of structural testing criteria

A binomial software reliability model based on coverage of structural testing criteria

Cobertura dos Critérios Potenciais-Usos e a Confiabilidade do Software

An approach to measuring and assessing dependability for critical software systems

Contact Info

Product

Resources

About