Probabilistic inference in multiply connected belief networks using loop cutsets

Suermondt, Henri J.; Cooper, Gregory F.

doi:10.1016/0888-613x(90)90003-k

Cited by 49 publications

(47 citation statements)

References 14 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Singly-connected nets were developed to allow the use of Pearl's belief revision algorithm, but in any realistic case the constraints are more suitably modelled by a multiply-connected net [5]. A variety of relaxation labelling algorithms are available for such problems [7,8] but have the disadvantage that we lose the theoretical justification provided by statistical decision theory.…”

Section: Discussionmentioning

confidence: 99%

“…Several techniques are suggested by Pearl [4] for the simplification and solution of multiply-connected nets -clustering of variables, instantiation of selected variables [5], and stochastic sampling. The first two techniques render the net singly-connected, which allows a solution to be constructed by replacing the optimisation by a sequence of nested optimisations, as described in the next section.…”

Section: Network Transformationmentioning

confidence: 99%

See 1 more Smart Citation

Boundary detection using Bayesian nets

Bryson

Taylor

1992

Image and Vision Computing

View full text Add to dashboard Cite

show abstract

Section: Discussionmentioning

confidence: 99%

Section: Network Transformationmentioning

confidence: 99%

Boundary detection using Bayesian nets

Bryson

Taylor

1992

Image and Vision Computing

View full text Add to dashboard Cite

show abstract

“…The time complexity of the algorithm is O( [(n + e) exp(f )] |C| ). Finding the optimal (smallest) cutset is NPhard [63]; different methods have been suggested for finding such a cutset [8,26,62,63].…”

Section: Cutset Conditioningmentioning

confidence: 99%

Conditioning Graphs: Practical Structures for Inference in Bayesian Networks

Grant

Horsch

2005

AI 2005: Advances in Artificial Intelligence

View full text Add to dashboard Cite

Probability is a useful tool for reasoning when faced with uncertainty. Bayesian networks offer a compact representation of a probabilistic problem, exploiting independence amongst variables that allows a factorization of the joint probability into much smaller local probability distributions.The standard approach to probabilistic inference in Bayesian networks is to compile the graph into a join-tree, and perform computation over this secondary structure. While join-trees are among the most time-efficient methods of inference in Bayesian networks, they are not always appropriate for certain applications. The memory requirements of join-tree can be prohibitively large. The algorithms for computing over join-trees are large and involved, making them difficult to port to other systems or be understood by general programmers without Bayesian network expertise.This thesis proposes a different method for probabilistic inference in Bayesian networks. We present a data structure called a conditioning graph, which is a runtime representation of Bayesian network inference. The structure mitigates many of the problems of join-tree inference. For example, conditioning graphs require much less space to store and compute over. The algorithm for calculating probabilities from a conditioning graph is small and basic, making it portable to virtually any architecture. And the details of Bayesian network inference are compiled away during the construction of the conditioning graph, leaving an intuitive structure that is easy to understand and implement without any Bayesian network expertise.In addition to the conditioning graph architecture, we present several improvements to the model, that maintain its small and simplistic style while reducing the runtime required for computing over it. We present two heuristics for choosing variable orderings that result in shallower elimination trees, reducing the overall complexity of computing over conditioning graphs. We also demonstrate several compile ii and runtime extensions to the algorithm, that can produce substantial speedup to the algorithm while adding a small space constant to the implementation. We also show how to cache intermediate values in conditioning graphs during probabilistic computation, that allows conditioning graphs to perform at the same speed as standard methods by avoiding duplicate computation, at the price of more memory.The methods presented also conform to the basic style of the original algorithm.We demonstrate a novel technique for reducing the amount of required memory for caching.We demonstrate empirically the compactness, portability, and ease of use of conditioning graphs. We also show that the optimizations of conditioning graphs allow competitive behaviour with standard methods in many circumstances, while still preserving its small and simple style. Finally, we show that the memory required under caching can be quite modest, meaning that conditioning graphs can be competitive with standard methods in terms of time, using a fraction of the mem...

show abstract

“…In particular, we examined cutset conditioning on multiply-connected networks. We proved that finding a minimal cutset is NP-hard, and we developed and evaluated a heuristic for finding small cutsets [19]. …”

Section: Studying and Extending Cutset Conditioningmentioning

confidence: 99%