Uncertainty arises in reinforcement learning from various sources, and therefore it is necessary to consider statistics based on several roll-outs for evaluating behavioral policies. We add an adaptive uncertainty handling based on Hoeffding and empirical Bernstein races to the CMA-ES, a variable metric evolution strategy proposed for direct policy search. The uncertainty handling adjusts individually the number of episodes considered for the evaluation of a policy. The performance estimation is kept just accurate enough for a sufficiently good ranking of candidate policies, which is in turn sufficient for the CMA-ES to find better solutions. This increases the learning speed as well as the robustness of the algorithm.
Context. The solar wind originating from coronal holes is comparatively well-understood and is characterized by lower densities and average charge states compared to the so-called slow solar wind. Except for wave perturbations, the average properties of the coronal-hole solar wind are passably constant. Aims. In this case study, we focus on observations of the Solar Wind Ion Composition Spectrometer (SWICS) on the Advanced Composition Explorer (ACE) of individual streams of coronal-hole solar wind that illustrate that although the O and C charge states are low in coronal-hole wind, the Fe charge distribution is more variable. In particular, we illustrate that the Fe charge states in coronal-hole solar wind are frequently as high as in slow solar wind. Methods. We selected individual coronal-hole solar wind streams based on their collisional age as well as their respective O and C charge states and analyzed their Fe charge-state distributions. Additionally, with a combination of simple ballistic back-mapping and the potential field source surface model, transitions between streams with high and low Fe charge states were mapped back to the photosphere. The relative frequency of high and low Fe charge-state streams is compared for the years 2004 and 2006. Results. We found several otherwise typical coronal-hole streams that include Fe charge states either as high as or lower than in slow solar wind. Eight such transitions in 2006 were mapped back to equatorial coronal holes that were either isolated or connected to the northern coronal-hole. Attempts to identify coronal structures associated with the transitions were so far inconclusive.
Context. The interstellar flow longitude corresponds to the Sun's direction of movement relative to the local interstellar medium. Thus, it constitutes a fundamental parameter for our understanding of the heliosphere and, in particular, its interaction with its surroundings, which is currently investigated by the Interstellar Boundary EXplorer (IBEX). One possibility to derive this parameter is based on pickup ions (PUIs) that are former neutral ions that have been ionized in the inner heliosphere. The neutrals enter the heliosphere as an interstellar wind from the direction of the Sun's movement against the partially ionized interstellar medium. PUIs carry information about the spatial variation of their neutral parent population (density and flow vector field) in their velocity distribution function. From the symmetry of the longitudinal flow velocity distribution, the interstellar flow longitude can be derived. Aims. The aim of this paper is to identify and eliminate systematic errors that are connected to this approach of measuring the interstellar flow longitude; we want to minimize any systematic influences on the result of this analysis and give a reasonable estimate for the uncertainty. Methods. We use He + data measured by the PLAsma and SupraThermal Ion Composition (PLASTIC) sensor on the Solar TErrestrial RElations Observatory Ahead (STEREO A) spacecraft. We analyze a recent approach, identify sources of systematic errors, and propose solutions to eliminate them. Furthermore, a method is introduced to estimate the error associated with this approach. Additionally, we investigate how the selection of interplanetary magnetic field angles, which is closely connected to the pickup ion velocity distribution function, affects the result for the interstellar flow longitude. Results. We find that the revised analysis used to address part of the expected systematic effects obtains significantly different results than presented in the previous study. In particular, the derived uncertainties are considerably larger. Furthermore, an unexpected systematic trend of the resulting interstellar flow longitude with the selection of interplanetary magnetic field orientation is uncovered.
Since the 1970s it has been empirically known that the area of solar coronal holes affects the properties of high-speed solar wind streams (HSSs) at Earth. We derive a simple analytical model for the propagation of HSSs from the Sun to Earth and thereby show how the area of coronal holes and the size of their boundary regions affect the HSS velocity, temperature, and density near Earth. We assume that velocity, temperature, and density profiles form across the HSS cross section close to the Sun and that these spatial profiles translate into corresponding temporal profiles in a given radial direction due to the solar rotation. These temporal distributions drive the stream interface to the preceding slow solar wind plasma and disperse with distance from the Sun. The HSS properties at 1 AU are then given by all HSS plasma parcels launched from the Sun that did not run into the stream interface at Earth distance. We show that the velocity plateau region of HSSs as seen at 1 AU, if apparent, originates from the center region of the HSS close to the Sun, whereas the velocity tail at 1 AU originates from the trailing boundary region. Small HSSs can be described to entirely consist of boundary region plasma, which intrinsically results in smaller peak velocities. The peak velocity of HSSs at Earth further depends on the longitudinal width of the HSS close to the Sun. The shorter the longitudinal width of an HSS close to the Sun, the more of its “fastest” HSS plasma parcels from the HSS core and trailing boundary region have impinged upon the stream interface with the preceding slow solar wind, and the smaller is the peak velocity of the HSS at Earth. As the longitudinal width is statistically correlated to the area of coronal holes, this also explains the well-known empirical relationship between coronal hole areas and HSS peak velocities. Further, the temperature and density of HSS plasma parcels at Earth depend on their radial expansion from the Sun to Earth. The radial expansion is determined by the velocity gradient across the HSS boundary region close to the Sun and gives the velocity-temperature and density-temperature relationships at Earth their specific shape. When considering a large number of HSSs, the assumed correlation between the HSS velocities and temperatures close to the Sun degrades only slightly up to 1 AU, but the correlation between the velocities and densities is strongly disrupted up to 1 AU due to the radial expansion. Finally, we show how the number of particles of the piled-up slow solar wind in the stream interaction region depends on the velocities and densities of the HSS and preceding slow solar wind plasma.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.
hi@scite.ai
10624 S. Eastern Ave., Ste. A-614
Henderson, NV 89052, USA
Copyright © 2024 scite LLC. All rights reserved.
Made with 💙 for researchers
Part of the Research Solutions Family.