No abstract

No abstract

Cargo-bearing unmanned aerial vehicles (UAVs) have tremendous potential to assist humans by delivering food, medicine, and other supplies. For time-critical cargo delivery tasks, UAVs need to be able to quickly navigate their environments and deliver suspended payloads with bounded load displacement. As a constraint balancing task for joint UAV-suspended load system dynamics, this task poses a challenge. This article presents a reinforcement learning approach for aerial cargo delivery tasks in environments with static obstacles. We first learn a minimal residual oscillations task policy in obstacle-free environments using a specifically designed feature vector for value function approximation that allows generalization beyond the training domain. The method works in continuous state and discrete action spaces. Since planning for aerial cargo requires very large action space (over 10 6 actions) that is impractical for learning, we define formal conditions for a class of robotics problems where learning can occur in a simplified problem space and successfully transfer to a broader problem space. Exploiting these guarantees and relying on the discrete action space, we learn the swing-free policy in a subspace several orders of magnitude smaller, and later develop a method for swing-free trajectory planning along a path. As an extension to tasks in environments with static obstacles where the load displacement needs to be bounded throughout the trajectory, sampling-based motion planning generates collision-free paths. Next, a reinforcement learning agent transforms these paths into trajectories that maintain the bound on the load displacement while following the collision-free path in a timely manner. We verify the approach both in simulation and in experiments on a quadrotor with suspended load and verify the method's safety and feasibility through a demonstration where a quadrotor delivers an open container of liquid to a human subject. The contributions of this work are twofold. First, this article presents a solution to a challenging, and vital problem of planning a constraint-balancing task for an inherently unstable non-linear system in the presence of obstacles. Second, AI and robotics researchers can both benefit from the provided theoretical guarantees of system stability on a class of constraint-balancing tasks that occur in very large action spaces.

No abstract

No abstract

In this paper, we address the problem of lifting from the ground a cable-suspended load by a quadrotor aerial vehicle. Furthermore, we consider that the mass of the load is unknown. The lift maneuver is a critical step before proceeding with the transportation of a given cargo. However, it has received little attention in the literature so far. To deal with this problem, we break down the lift maneuver into simpler modes which represent the dynamics of the quadrotor-load system at particular operating regimes. From this decomposition, we obtain a series of waypoints that the aerial vehicle has to reach to accomplish the task. We combine geometric control with a least-squares estimation method to design an adaptive controller that follows a prescribed trajectory planned based on the waypoints. The effectiveness of the proposed control scheme is demonstrated by numerical simulations.

No abstract

Autonomous multi-rotor aerial vehicles, specially quadrotors, have become popular platforms for the transportation of cable-suspended loads. Before transporting the load, the lift maneuver is a crucial step that needs to be planed. In order to perform this essential maneuver, we decompose it into simpler hybrid modes which characterize the dynamics of the quadrotor-load system in specific regimes during the maneuver. In this work, we represent the maneuver as a hybrid system and show that it is differentially flat. This property facilitates the generation of a prescribed trajectory and the design of a trajectory tracking controller based on geometric control. Numerical simulations show promising results on the performance of the proposed control architecture.