2018
DOI: 10.3390/e20090650
|View full text |Cite
|
Sign up to set email alerts
|

Beyond Moments: Extending the Maximum Entropy Principle to Feature Distribution Constraints

Abstract: The maximum entropy principle introduced by Jaynes proposes that a data distribution should maximize the entropy subject to constraints imposed by the available knowledge. Jaynes provided a solution for the case when constraints were imposed on the expected value of a set of scalar functions of the data. These expected values are typically moments of the distribution. This paper describes how the method of maximum entropy PDF projection can be used to generalize the maximum entropy principle to constraints on … Show more

Help me understand this report

Search citation statements

Order By: Relevance

Paper Sections

Select...
1
1

Citation Types

0
2
0

Year Published

2019
2019
2024
2024

Publication Types

Select...
7

Relationship

0
7

Authors

Journals

citations
Cited by 9 publications
(2 citation statements)
references
References 38 publications
0
2
0
Order By: Relevance
“…The maximum entropy principle is extensively applied in many disciplines [ 28 , 29 , 30 , 31 , 32 ]. In information theory, if there is a discrete random variable, X , with possible values of { x1, x2, …, xn }, and probability mass function, P(X ), the entropy, H, of X is defined as follows: where E is the expectation operator, r is the logarithmic base, which generally takes a value of two [ 33 , 34 , 35 ] (in this study, r = 2).…”
Section: Methodsmentioning
confidence: 99%
“…The maximum entropy principle is extensively applied in many disciplines [ 28 , 29 , 30 , 31 , 32 ]. In information theory, if there is a discrete random variable, X , with possible values of { x1, x2, …, xn }, and probability mass function, P(X ), the entropy, H, of X is defined as follows: where E is the expectation operator, r is the logarithmic base, which generally takes a value of two [ 33 , 34 , 35 ] (in this study, r = 2).…”
Section: Methodsmentioning
confidence: 99%
“…Duplicate presence records were removed using basic settings along with random seed feature. Ten replicates were run for both models and logistic outputs were selected using Baggenstoss 2018 [2] ; Presse et al 2013 [39] ; Phillips and Dudik 2008. Jackknife approach was adopted to determine the importance of the variables used in the model (Hoenes and Bender 2010; Yost et al 2009) [20,48] .…”
Section: Climate Data Extraction and Analysismentioning
confidence: 99%