Quantification of Model Uncertainty Based on Variance and Entropy of Bernoulli Distribution

Abstract

This article studies the role of model uncertainties in sensitivity and probability analysis of reliability. The measure of reliability is failure probability. The failure probability is analysed using the Bernoulli distribution with binary outcomes of success (0) and failure (1). Deeper connections between Shannon entropy and variance are explored. Model uncertainties increase the heterogeneity in the data 0 and 1. The article proposes a new methodology for quantifying model uncertainties based on the equality of variance and entropy. This methodology is briefly called “variance = entropy”. It is useful for stochastic computational models without additional information. The “variance = entropy” rule estimates the “safe” failure probability with the added effect of model uncertainties without adding random variables to the computational model. Case studies are presented with seven variants of model uncertainties that can increase the variance to the entropy value. Although model uncertainties are justified in the assessment of reliability, they can distort the results of the global sensitivity analysis of the basic input variables. The solution to this problem is a global sensitivity analysis of failure probability without added model uncertainties. This paper shows that Shannon entropy is a good sensitivity measure that is useful for quantifying model uncertainties.

Quantitative Assessment and Analysis of Fish Behavior in Closed Systems Using Information Entropy

“…Therefore, when the probability of a fish "swimming within a certain range" is 1 (i.e., the probability of other possibilities is 0), the information entropy becomes 0, indicating that the state of the fish can be predicted with certainty. This concept of information entropy has been shown to be useful in various fields for evaluating the characteristics of data and information and quantifying uncertainty [17][18][19][20][21][22][23]. This paper demonstrates that it is possible to quantitatively evaluate the behavior of fish shoals in a closed system using information entropy.…”

Quantitative Assessment and Analysis of Fish Behavior in Closed Systems Using Information Entropy

“…Research into fish movement has established that fish exhibit characteristics akin to a random walk-a pattern of movement inherently random in nature. For instance, organisms like Daphnia pulex and Temora longicornis have been observed performing multifractal random walks, behaviors linked to mating, foraging, and predator evasion strategies [24,25]. Moreover, studies have illustrated that movements within fish populations can be depicted through biased random walks, incorporating both directional movement and exploratory behavior [26].…”

Derivative-Variance Hybrid Global Sensitivity Measure with Optimal Sampling Method Selection

“…In reliability engineering, a new reliability-oriented global sensitivity measure, which is obtained by replacing the variance with entropy, was proposed [20]. Connections between entropy and variance in reliability engineering have also been recently explored [21].…”