Entropy as a Robustness Marker in Genetic Regulatory Networks

Abstract

Genetic regulatory networks have evolved by complexifying their control systems with numerous effectors (inhibitors and activators). That is, for example, the case for the double inhibition by microRNAs and circular RNAs, which introduce a ubiquitous double brake control reducing in general the number of attractors of the complex genetic networks (e.g., by destroying positive regulation circuits), in which complexity indices are the number of nodes, their connectivity, the number of strong connected components and the size of their interaction graph. The stability and robustness of the networks correspond to their ability to respectively recover from dynamical and structural disturbances the same asymptotic trajectories, and hence the same number and nature of their attractors. The complexity of the dynamics is quantified here using the notion of attractor entropy: it describes the way the invariant measure of the dynamics is spread over the state space. The stability (robustness) is characterized by the rate at which the system returns to its equilibrium trajectories (invariant measure) after a dynamical (structural) perturbation. The mathematical relationships between the indices of complexity, stability and robustness are presented in case of Markov chains related to threshold Boolean random regulatory networks updated with a Hopfield-like rule. The entropy of the invariant measure of a network as well as the Kolmogorov-Sinaï entropy of the Markov transition matrix ruling its random dynamics can be considered complexity, stability and robustness indices; and it is possible to exploit the links between these notions to characterize the resilience of a biological system with respect to endogenous or exogenous perturbations. The example of the genetic network controlling the kinin-kallikrein system involved in a pathology called angioedema shows the practical interest of the present approach of the complexity and robustness in two cases, its physiological normal and pathological, abnormal, dynamical behaviors.

Quantification of the robustness of functional neural networks: application to the characterization of Alzheimer’s disease continuum

“…Different approaches to evaluate network robustness have been developed in the literature (Jiang et al 2014, Aerts et al 2016, Bellingeri and Cassi 2018, Bellingeri et al 2019, Farooq et al 2020, Freitas et al 2020, Heer et al 2020, Rachdi et al 2020, Williams and Patterson 2020, Stacey et al 2021.…”

Robust Spike-Based Continual Meta-Learning Improved by Restricted Minimum Error Entropy Criterion

“…Previously, Chen et al proposed researches focusing on maximum correntropy theory and minimum error entropy criteria to improve the robustness of machine learning theory [20][21][22]. In addition, a series of entropy-based learning algorithms have been presented to deal with the robustness improvement of machine learning models, including guided complement entropy and fuzzy entropy [23][24][25]. Nevertheless, there is no application of the ITL-based approach in the spike-based continual meta-learning to improve its learning robustness.…”

On the Solutions of a Quadratic Integral Equation of the Urysohn Type of Fractional Variable Order

“…Any new contribution in the area of fractional differential and integral operators can offer new opportunities for future progress and expansion of the theory of fractional-order entropies. It will also contribute to the progress of the entropy methods in applied sciences such as mathematical biology and artificial neural networks that used integral equations as modeling tools [ 18 , 19 , 20 ].…”