Recent works have suggested that finite Bayesian neural networks may outperform their infinite cousins because finite networks can flexibly adapt their internal representations. However, our theoretical understanding of how the learned hidden layer representations of finite networks differ from the fixed representations of infinite networks remains incomplete. Perturbative finite-width corrections to the network prior and posterior have been studied, but the asymptotics of learned features have not been fully characterized. Here, we argue that the leading finite-width corrections to the average feature kernels for any Bayesian network with linear readout and quadratic cost have a largely universal form. We illustrate this explicitly for two classes of fully connected networks: deep linear networks and networks with a single nonlinear hidden layer. Our results begin to elucidate which features of data wide Bayesian neural networks learn to represent.
Micromechanical studies of mitotic chromosomes have revealed them to be remarkably extensible objects and informed early models of mitotic chromosome organization. We use a data-driven, coarse-grained polymer modeling approach, capable of generating ensembles of chromosome structures that are quantitatively consistent with experiments, to explore the relationship between the spatial organization of individual chromosomes and their emergent mechanical properties. In particular, we investigate the mechanical properties of our model chromosomes by axially stretching them. Simulated stretching led to a linear force-extension curve for small strain, with mitotic chromosomes behaving about ten-fold stiffer than interphase chromosomes. Studying the relaxation dynamics we found that chromosomes are viscoelastic solids, with a highly liquid-like, viscous behavior in interphase that becomes solid-like in mitosis. This emergent mechanical stiffness in our model originates from lengthwise compaction, an effective potential capturing the activity of loop-extruding SMC complexes. Chromosomes denature under large strains via unraveling, which is characterized by opening of large-scale folding patterns. By quantifying the effect of mechanical perturbations on the chromosome's structural features, our model provides a nuanced understanding of in vivo mechanics of chromosomes.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.