Quadrotor stabilizing controllers often require careful, model-specific tuning for safe operation. We use reinforcement learning to train policies in simulation that transfer remarkably well to multiple different physical quadrotors. Our policies are low-level, i.e., we map the rotorcrafts' state directly to the motor outputs. The trained control policies are very robust to external disturbances and can withstand harsh initial conditions such as throws. We show how different training methodologies (change of the cost function, modeling of noise, use of domain randomization) might affect flight performance. To the best of our knowledge, this is the first work that demonstrates that a simple neural network can learn a robust stabilizing low-level quadrotor controller (without the use of a stabilizing PD controller) that is shown to generalize to multiple quadrotors. The video of our experiments can be found at https://sites.google.com/ view/sim-to-multi-quad.
We propose a method for controlling multiple active drifters in the presence of external forcing induced by the ocean. Our active drifters have one actuator: they can lower and raise their drogues in depth. By exploiting the vertically stratified nature of ocean currents, we show how classical multi-robot tasks (spreading out and aggregation) can be accomplished by the multi-drifter system. Tests with a realistic simulation based on an ocean model suggest that a practical implementation of active drifters which aggregate and disperse in the coastal ocean could be realized through our control method with relatively inexpensive components. Specifically, we are able to show that over a 90 day deployment a significant fraction of drifters can be made to aggregate in few clusters suitable for recovery.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.