Attention to the Variation of Probabilistic Events: Information Processing with Message Importance Measure

Abstract

Different probabilities of events attract different attention in many scenarios such as anomaly detection and security systems. To characterize the events’ importance from a probabilistic perspective, the message importance measure (MIM) is proposed as a kind of semantics analysis tool. Similar to Shannon entropy, the MIM has its special function in information representation, in which the parameter of MIM plays a vital role. Actually, the parameter dominates the properties of MIM, based on which the MIM has three work regions where this measure can be used flexibly for different goals. When the parameter is positive but not large enough, the MIM not only provides a new viewpoint for information processing but also has some similarities with Shannon entropy in the information compression and transmission. In this regard, this paper first constructs a system model with message importance measure and proposes the message importance loss to enrich the information processing strategies. Moreover, the message importance loss capacity is proposed to measure the information importance harvest in a transmission. Furthermore, the message importance distortion function is discussed to give an upper bound of information compression based on the MIM. Additionally, the bitrate transmission constrained by the message importance loss is investigated to broaden the scope for Shannon information theory.

Robust, practical and comprehensive analysis of soft compression image coding algorithms for big data

“…To date, mutual information has been effectively applied in many fields, such as telecommunications [7] and machine learning [8,9]. In this study, we focus on three notable mutual information metrics, shannon mutual information [1], α-mutual information [10] and message importance measure loss [11].…”

“…MIM loss has been used in several fields such as information compression, distribution estimation, anomaly detection, recommendation and IoT [11,17] . The parameter in MIM can be selected to amplify the weights of certain elements according to user's preference [18].…”

Abnormal Human Behavior Detection in Videos: A Review

“…Different probabilities of behaviors cause different attention in many fields of view [151]. To identify the events importance from the point of probabilistic, She et al [115] proposed a semantics analysis tool of message importance measure (MIM). The MIM is a generalized Shannon information theory.…”

Information Theoretic Measures and Their Applications

“…Attention to the Variation of Probabilistic Events: Information Processing with Message Importance Measure. By She, R.; Liu, S.; Fan, P. [ 1 ]…”