A defining feature of sampling-based motion planning is the reliance on an implicit representation of the state space, which is enabled by a set of probing samples. Traditionally, these samples are drawn either probabilistically or deterministically to uniformly cover the state space. Yet, the motion of many robotic systems is often restricted to "small" regions of the state space, due to, for example, differential constraints or collision-avoidance constraints. To accelerate the planning process, it is thus desirable to devise non-uniform sampling strategies that favor sampling in those regions where an optimal solution might lie. This paper proposes a methodology for non-uniform sampling, whereby a sampling distribution is learned from demonstrations, and then used to bias sampling. The sampling distribution is computed through a conditional variational autoencoder, allowing sample generation from the latent space conditioned on the specific planning problem. This methodology is general, can be used in combination with any samplingbased planner, and can effectively exploit the underlying structure of a planning problem while maintaining the theoretical guarantees of sampling-based approaches. Specifically, on several planning problems, the proposed methodology is shown to effectively learn representations for the relevant regions of the state space, resulting in an order of magnitude improvement in terms of success rate and convergence to the optimal cost. * These authors contributed equally to this work.This work was originally presented at the 2018 IEEE International Conference on Robotics and Automation (ICRA). This extended version includes new numerical experiments demonstrating generalization, iterative retraining of the generative model, and multirobot planning experiments.

Large language models can encode a wealth of semantic knowledge about the world. Such knowledge could be extremely useful to robots aiming to act upon high-level, temporally extended instructions expressed in natural language. However, a significant weakness of language models is that they lack real-world experience, which makes it difficult to leverage them for decision making within a given embodiment. For example, asking a language model to describe how to clean a spill might result in a reasonable narrative, but it may not be applicable to a particular agent, such as a robot, that needs to perform this task in a particular environment. We propose to provide real-world grounding by means of pretrained skills, which are used to constrain the model to propose natural language actions that are both feasible and contextually appropriate. The robot can act as the language model's "hands and eyes," while the language model supplies high-level semantic knowledge about the task. We show how low-level skills can be combined with large language models so that the language model provides high-level knowledge about the procedures for performing complex and temporally extended instructions, while value functions associated with these skills provide the grounding necessary to connect this knowledge to a particular physical environment. We evaluate our method on a number of real-world robotic tasks, where we show the need for real-world grounding and that this approach is capable of completing long-horizon, abstract, natural language instructions on a mobile manipulator. The project's website and the video can be found at say-can.github.io. (a) Large Language Models (LLMs) (b) SayCan

This paper presents Latent Sampling-based Motion Planning (L-SBMP), a methodology towards computing motion plans for complex robotic systems by learning a plannable latent representation. Recent works in control of robotic systems have effectively leveraged local, low-dimensional embeddings of high-dimensional dynamics. In this paper we combine these recent advances with techniques from samplingbased motion planning (SBMP) in order to design a methodology capable of planning for high-dimensional robotic systems beyond the reach of traditional approaches (e.g., humanoids, or even systems where planning occurs in the visual space). Specifically, the learned latent space is constructed through an autoencoding network, a dynamics network, and a collision checking network, which mirror the three main algorithmic primitives of SBMP, namely state sampling, local steering, and collision checking. Notably, these networks can be trained through only raw data of the system's states and actions along with a supervising collision checker. Building upon these networks, an RRT-based algorithm is used to plan motions directly in the latent space -we refer to this exploration algorithm as Learned Latent RRT (L2RRT). This algorithm globally explores the latent space and is capable of generalizing to new environments. The overall methodology is demonstrated on two planning problems, namely a visual planning problem, whereby planning happens in the visual (pixel) space, and a humanoid robot planning problem.

No abstract

Probabilistic sampling-based algorithms, such as the probabilistic roadmap (PRM) and the rapidly-exploring random tree (RRT) algorithms, represent one of the most successful approaches to robotic motion planning, due to their strong theoretical properties (in terms of probabilistic completeness or even asymptotic optimality) and remarkable practical performance.Such algorithms are probabilistic in that they compute a path by connecting independently and identically distributed (i.i.d.) random points in the configuration space. Their randomization aspect, however, makes several tasks challenging, including certification for safety-critical applications and use of offline computation to improve real-time execution. Hence, an important open question is whether similar (or better) theoretical guarantees and practical performance could be obtained by considering deterministic, as opposed to random sampling sequences. The objective of this paper is to provide a rigorous answer to this question. Specifically, we first show that PRM, for a certain selection of tuning parameters and deterministic low-dispersion sampling sequences, is deterministically asymptotically optimal, i.e., it returns a path whose cost converges deterministically to the optimal one as the number of points goes to infinity. Second, we characterize the convergence rate, and we find that the factor of sub-optimality can be very explicitly upper-bounded in terms of the 2 -dispersion of the sampling sequence and the connection radius of PRM. Third, we show that an asymptotically optimal version of PRM exists with computational and space complexity arbitrarily close to O(n) (the theoretical lower bound), where n is the number of points in the sequence. This is in stark contrast to the O(n log n) complexity results for existing asymptoticallyoptimal probabilistic planners. Fourth, we show that our theoretical results and insights extend to other batch-processing * Corresponding author; email: pavone@stanford.edu This work was originally presented at the 17th International Symposium on Robotics Research, ISRR 2015. This extended and revised version includes a novel section on extensions of this work to k-nearest-neighbor algorithms, non-PRM algorithms, non-lattice sampling, non-uniform sampling, and kinodynamic motion planning. It also includes a significantly extended simulation section. arXiv:1505.00023v2 [cs.RO] 3 May 2016algorithms such as FMT * , to non-uniform sampling strategies, to k-nearest-neighbor implementations, and to differentiallyconstrained problems. Finally, through numerical experiments, we show that planning with deterministic low-dispersion sampling generally provides superior performance in terms of path cost and success rate.

No abstract

Downwind force angles are small for current turbines systems (1–5 MW) such that they may be readily accommodated by conventional upwind configurations. However, analysis indicates that extreme‐scale systems (10–20 MW) will have larger angles that may benefit from downwind‐aligned configurations. To examine potential rotor mass reduction, the pre‐alignment concept was investigated a two‐bladed configuration by keeping the structural and aerodynamic characteristics of each blade fixed (to avoids a complete blade re‐design). Simulations for a 13.2 MW rated rotor at steady‐state conditions show that this concept‐level two‐bladed design may yield 25% rotor mass savings while also reducing average blade stress over all wind speeds. These results employed a pre‐alignment on the basis of a wind speed of 1.25 times the rated wind speed. The downwind pre‐aligned concept may also reduce damage equivalent loads on the blades by 60% for steady rated wind conditions. Even higher mass and damage equivalent load savings (relative to conventional upwind designs) may be possible for larger systems (15–20 MW) for which load‐alignment angles become even larger. However, much more work is needed to determine whether this concept can be translated into a practical design that must meet a wide myriad of other criteria. Copyright © 2017 John Wiley & Sons, Ltd.

No abstract