Implementation of a Stereo vision based system for visual feedback control of Robotic Arm for space manipulations

G.R, Sangeetha; Kumar, N. Udhaya; Hari, Priyadarshnam; Sasikumar, Sachin

doi:10.1016/j.procs.2018.07.031

Cited by 10 publications

(1 citation statement)

References 2 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Therefore, a robot manipulator integrated with machine vision is a widely implemented technology. For instance, Sangeetha et al [15] developed a low-cost eye-in-hand system that included a robot arm and a set of stereo cameras. The object position was detected by the stereo camera based on image processing.…”

Section: Introductionmentioning

confidence: 99%

Hybrid Navigation of an Autonomous Mobile Robot to Depress an Elevator Button

Wu,

Zhang,

Liew

et al. 2023

JAMRIS

View full text Add to dashboard Cite

The development of an autonomous mobile robot (AMR) with an eye-in-hand robot arm atop for depressing elevator button is proposed. The AMR can construct map and perform localization using the ORB-SLAM algorithm (the Oriented FAST (Features from Accelerated Segment Test) and Rotated BRIEF (Binary Robust Independent Elementary Features) feature detector-Simultaneous Localization and Mapping). It is also capable of real-time obstacle avoidance using information from 2D-LiDAR sensors. The AMR, robot manipulator, cameras, and sensors are all integrated under robot operating system (ROS). In experimental investigation to dispatch the AMR for depressing an elevator button, AMR navigation initiating from the laboratory is divided into three parts. First, the AMR initiated navigation using ORB-SLAM for most of the journey to a waypoint nearby the elevator. The resulting mean absolute error (MAE) is 8.5 cm on the x-axis, 10.8 cm on the y-axis, 9.2-degree rotation angle about the z-axis, and the linear displacement from the reference point is 15.1 cm. Next, the ORB-SLAM is replaced by an odometry based 2D-SLAM method for further navigating the AMR from waypoint to a point facing the elevator between 1.5 to 3 meter distance, where the ORB-SLAM is ineffective due to sparse feature points for localization and where the elevator can be clearly detected by an eye-in-hand machine vision onboard the AMR. Finally, the machine vision identifies space position of the elevator and again the odometry based 2D SLAM method is employed for navigating the AMR to front of the elevator between 0.3 to 0.5 meter distance. Only at this stage, the small-size elevator button can be detected and reached by the robot arm on the AMR. An averaged 60% successful rate of button depressing by the AMR starting at the laboratory is obtained in the experiments. Improvements of successful elevator button depressing rate are also pointed out.

show abstract

Section: Introductionmentioning

confidence: 99%