Birds and gliders exploit warm, rising atmospheric currents (thermals) to reach heights comparable to low-lying clouds with a reduced expenditure of energy. This strategy of flight (thermal soaring) is frequently used by migratory birds. Soaring provides a remarkable instance of complex decision making in biology and requires a longterm strategy to effectively use the ascending thermals. Furthermore, the problem is technologically relevant to extend the flying range of autonomous gliders. Thermal soaring is commonly observed in the atmospheric convective boundary layer on warm, sunny days. The formation of thermals unavoidably generates strong turbulent fluctuations, which constitute an essential element of soaring. Here, we approach soaring flight as a problem of learning to navigate complex, highly fluctuating turbulent environments. We simulate the atmospheric boundary layer by numerical models of turbulent convective flow and combine them with model-free, experience-based, reinforcement learning algorithms to train the gliders. For the learned policies in the regimes of moderate and strong turbulence levels, the glider adopts an increasingly conservative policy as turbulence levels increase, quantifying the degree of risk affordable in turbulent environments. Reinforcement learning uncovers those sensorimotor cues that permit effective control over soaring in turbulent environments.thermal soaring | turbulence | navigation | reinforcement learning M igrating birds and gliders use upward wind currents in the atmosphere to gain height while minimizing the energy cost of propulsion by the flapping of the wings or engines (1, 2). This mode of flight, called soaring, has been observed in a variety of birds. For instance, birds of prey use soaring to maintain an elevated vantage point in their search for food (3); migrating storks exploit soaring to cover large distances in their quest for greener pastures (4). Different forms of soaring have been observed. Of particular interest here is thermal soaring, where a bird gains height by using warm air currents (thermals) formed in the atmospheric boundary layer. For both birds and gliders, a crucial part of the thermal soaring is to identify a thermal and to find and maintain its core, where the lift is typically the largest. Once migratory birds have climbed up to the top of a thermal, they glide down to the next thermal and repeat the process, a migration strategy that strongly reduces energy costs (4). Soaring strategies are also important for technological applications, namely, the development of autonomous gliders that can fly large distances with minimal energy consumption (5).Thermals arise as ascending convective plumes driven by the temperature gradient created due to the heating of the earth's surface by the sun (6). Hydrodynamic instabilities and processes that lead to the formation of a thermal inevitably give rise to a turbulent environment characterized by strong, erratic fluctuations (7,8). Birds or gliders attempting to find and maintain a thermal face...

Natural environments feature mixtures of odorants of diverse quantities, qualities and complexities. Olfactory receptor neurons (ORNs) are the first layer in the sensory pathway and transmit the olfactory signal to higher regions of the brain. Yet, the response of ORNs to mixtures is strongly non-additive, and exhibits antagonistic interactions among odorants. Here, we model the processing of mixtures by mammalian ORNs, focusing on the role of inhibitory mechanisms. We show how antagonism leads to an effective ‘normalization’ of the ensemble ORN response, that is, the distribution of responses of the ORN population induced by any mixture is largely independent of the number of components in the mixture. This property arises from a novel mechanism involving the distinct statistical properties of receptor binding and activation, without any recurrent neuronal circuitry. Normalization allows our encoding model to outperform non-interacting models in odor discrimination tasks, leads to experimentally testable predictions and explains several psychophysical experiments in humans.

Soaring birds often rely on ascending thermal plumes (thermals) in the atmosphere as they search for prey or migrate across large distances. The landscape of convective currents is rugged and shifts on timescales of a few minutes as thermals constantly form, disintegrate or are transported away by the wind. How soaring birds find and navigate thermals within this complex landscape is unknown. Reinforcement learning provides an appropriate framework in which to identify an effective navigational strategy as a sequence of decisions made in response to environmental cues. Here we use reinforcement learning to train a glider in the field to navigate atmospheric thermals autonomously. We equipped a glider of two-metre wingspan with a flight controller that precisely controlled the bank angle and pitch, modulating these at intervals with the aim of gaining as much lift as possible. A navigational strategy was determined solely from the glider's pooled experiences, collected over several days in the field. The strategy relies on on-board methods to accurately estimate the local vertical wind accelerations and the roll-wise torques on the glider, which serve as navigational cues. We establish the validity of our learned flight policy through field experiments, numerical simulations and estimates of the noise in measurements caused by atmospheric turbulence. Our results highlight the role of vertical wind accelerations and roll-wise torques as effective mechanosensory cues for soaring birds and provide a navigational strategy that is directly applicable to the development of autonomous soaring vehicles.

Odor landscapes contain complex blends of molecules that each activate unique, overlapping populations of olfactory sensory neurons (OSNs). Despite the presence of hundreds of OSN subtypes in many animals, the overlapping nature of odor inputs may lead to saturation of neural responses at the early stages of stimulus encoding. Information loss due to saturation could be mitigated by normalizing mechanisms such as antagonism at the level of receptorligand interactions, whose existence and prevalence remains uncertain. By imaging OSN axon terminals in olfactory bulb glomeruli as well as OSN cell bodies within the olfactory epithelium in freely breathing mice, we find widespread antagonistic interactions in binary odor mixtures. In complex mixtures of up to 12 odorants, antagonistic interactions are stronger and more prevalent with increasing mixture complexity. Therefore, antagonism is a common feature of odor mixture encoding in OSNs and helps in normalizing activity to reduce saturation and increase information transfer.

Fluid turbulence is a double-edged sword for the navigation of macroscopic animals, such as birds, insects, and rodents. On one hand, turbulence enables pheromone communication among mates and the possibility of locating food by their odors from long distances. Molecular diffusion would indeed be unable to spread odors over relevant distances in natural conditions. On the other hand, turbulent flows are hard to predict, and learning effective maneuvers to navigate them is challenging, as we discuss in this review. We first provide a summary of the olfactory organs that sense airborne or surface-bound odors, as well as the computational tasks that animals face when extracting information useful for navigation from an olfactory signal. A compendium of the dynamics of turbulent transport emphasizes those aspects that directly impact animals’ behavior. The state of the art on navigational strategies is discussed, followed by a concluding section dedicated to future challenges in the field. Expected final online publication date for the Annual Review of Condensed Matter Physics, Volume 13 is March 2022. Please see http://www.annualreviews.org/page/journal/pubdates for revised estimates.