Abstract:Automating earth-moving tasks has the potential to resolve labour-shortage, allow for unseen designs and foster sustainability through using on-site materials. In this interdisciplinary project involving robotics and landscape architecture, we combine our previous work on autonomous excavation of free-form shapes, dynamic landscape design and terrain modelling tools into a robotic landscape system. It tightly connects survey, design and fabrication to exchange information in real-time during fabrication. We pu… Show more
“…HEAP ( 66 ) is additionally capable of autonomously excavating free-form embankments with high precision ( 72 ), given a designed target geometry defined as a 2.5D height map. Our design process generally begins with a map captured by surveying equipment or by aerial or excavator-mounted LiDAR.…”
Section: Resultsmentioning
confidence: 99%
“…We refined the stone poses of the final structure with a high-density point cloud produced by a surveying laser scanner (Leica RTC360) to assess the median positional error between planned and placed poses as 0.115 m and the mean pose error as (0.135 ± 0.089, 0.089 ± 0.111). 66) is additionally capable of autonomously excavating freeform embankments with high precision (72), given a designed target geometry defined as a 2.5D height map. Our design process generally begins with a map captured by surveying equipment or by aerial or excavator-mounted LiDAR.…”
Automated building processes that enable efficient in situ resource utilization can facilitate construction in remote locations while simultaneously offering a carbon-reducing alternative to commonplace building practices. Toward these ends, we present a robotic construction pipeline that is capable of planning and building freeform stone walls and landscapes from highly heterogeneous local materials using a robotic excavator equipped with a shovel and gripper. Our system learns from real and simulated data to facilitate the online detection and segmentation of stone instances in spatial maps, enabling robotic grasping and textured 3D scanning of individual stones and rubble elements. Given a limited inventory of these digitized stones, our geometric planning algorithm uses a combination of constrained registration and signed-distance-field classification to determine how these should be positioned toward the formation of stable and explicitly shaped structures. We present a holistic approach for the robotic manipulation of complex objects toward dry stone construction and use the same hardware and mapping to facilitate autonomous terrain-shaping on a single construction site. Our process is demonstrated with the construction of a freestanding stone wall (10 meters by 1.7 meters by 4 meters) and a permanent retaining wall (65.5 meters by 1.8 meters by 6 meters) that is integrated with robotically contoured terraces (665 square meters). The work illustrates the potential of autonomous heavy construction vehicles to build adaptively with highly irregular, abundant, and sustainable materials that require little to no transportation and preprocessing.
“…HEAP ( 66 ) is additionally capable of autonomously excavating free-form embankments with high precision ( 72 ), given a designed target geometry defined as a 2.5D height map. Our design process generally begins with a map captured by surveying equipment or by aerial or excavator-mounted LiDAR.…”
Section: Resultsmentioning
confidence: 99%
“…We refined the stone poses of the final structure with a high-density point cloud produced by a surveying laser scanner (Leica RTC360) to assess the median positional error between planned and placed poses as 0.115 m and the mean pose error as (0.135 ± 0.089, 0.089 ± 0.111). 66) is additionally capable of autonomously excavating freeform embankments with high precision (72), given a designed target geometry defined as a 2.5D height map. Our design process generally begins with a map captured by surveying equipment or by aerial or excavator-mounted LiDAR.…”
Automated building processes that enable efficient in situ resource utilization can facilitate construction in remote locations while simultaneously offering a carbon-reducing alternative to commonplace building practices. Toward these ends, we present a robotic construction pipeline that is capable of planning and building freeform stone walls and landscapes from highly heterogeneous local materials using a robotic excavator equipped with a shovel and gripper. Our system learns from real and simulated data to facilitate the online detection and segmentation of stone instances in spatial maps, enabling robotic grasping and textured 3D scanning of individual stones and rubble elements. Given a limited inventory of these digitized stones, our geometric planning algorithm uses a combination of constrained registration and signed-distance-field classification to determine how these should be positioned toward the formation of stable and explicitly shaped structures. We present a holistic approach for the robotic manipulation of complex objects toward dry stone construction and use the same hardware and mapping to facilitate autonomous terrain-shaping on a single construction site. Our process is demonstrated with the construction of a freestanding stone wall (10 meters by 1.7 meters by 4 meters) and a permanent retaining wall (65.5 meters by 1.8 meters by 6 meters) that is integrated with robotically contoured terraces (665 square meters). The work illustrates the potential of autonomous heavy construction vehicles to build adaptively with highly irregular, abundant, and sustainable materials that require little to no transportation and preprocessing.
“…While a static map can be generated from georeferenced aerial images [32]- [34], using an offline map is not possible for construction tasks in which robotic platforms actively change their environment. This phenomenon can be seen by moving bricks around during robotic wall building [35] or by altering the entire topography during autonomous robotic excavation [5].…”
Section: E State Estimation Methodsmentioning
confidence: 99%
“…The associate editor coordinating the review of this manuscript and approving it for publication was Abderrahmane Lakas . with agile control [5]. Incorporating robotic platforms in construction can not only compensate for the shortage of workers but also aid in performing complex tasks that require high skill, such as preparing wire mesh reinforcements for concrete or carving stone [6], [7].…”
Construction site preparation tasks rely on experienced operators and heavy machinery for clearing debris, earthmoving, leveling, and soil stabilization. These actions require complex collaboration between human teams to survey the site, estimate the material condition, and guide the operators accordingly. In recent years there has been a critical labor shortage due to increasing demands in construction. Integrating autonomous systems can mitigate this gap by replacing traditional methods with robotic solutions. However, while ideal conditions for automatic systems are static and highly controlled, construction sites are dynamic and unstructured environments. The ability of autonomous systems to overcome these conditions during outdoor construction site preparation tasks relies on their capacity to map the material on-site and continuously perform localization. This study suggests a solution to these problems by collaborating between an Unmanned Aerial Vehicle (UAV) and an Unmanned Ground Vehicle (UGV). In this method, the UAV produces a material map and monitors the UGV's location relative to known static landmarks. These measurements are then sent to the ground vehicle and are added to the onboard sensors using the Extended Kalman Filter (EKF) approach. Thus, the UAV enhances the operation of the UGV by providing an accurate localization and mapping from the air and allowing it to perform a site-preparation task beyond mere sensing. This approach is examined with simulation and validated by outdoor experiments. Additionally, this method is integrated within Shepherd, a custom-developed plugin for computer-aided design applications.
“…The used reference frames are defined as: the fixed-world frame (W), the local odometry frame (O), the IMU frame (I), the lidar frame (L), and the GNSS frame (G). Furthermore, the excavator chassis base frame (B) and cabin frame (C) are defined, as they are required for generating driving motions and controlling the chassis [1], the control of the arm [27] and the cabin [28], respectively. These two frames are rotated against each other through the cabin turn joint.…”
Enabling autonomous operation of large-scale construction machines, such as excavators, can bring key benefits for human safety and operational opportunities for applications in dangerous and hazardous environments. To facilitate robot autonomy, robust and accurate state-estimation remains a core component to enable these machines for operation in a diverse set of complex environments. In this work, a method for multimodal sensor fusion for robot state-estimation and localization is presented, enabling operation of construction robots in realworld scenarios. The proposed approach presents a graph-based prediction-update loop that combines the benefits of filtering and smoothing in order to provide consistent state estimates at high update rate, while maintaining accurate global localization for large-scale earth-moving excavators. Furthermore, the proposed approach enables a flexible integration of asynchronous sensor measurements and provides consistent pose estimates even during phases of sensor dropout. For this purpose, a dualgraph design for switching between two distinct optimization problems is proposed, directly addressing temporary failure and the subsequent return of global position estimates. The proposed approach is implemented on-board two Menzi Muck walking excavators and validated during real-world tests conducted in representative operational environments.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.