Purpose
Currently, the vision and depth information obtained from the eye-to-hand RGB-D camera can apply to the reconstruction of the three-dimensional (3D) environment for a robotic operation workspace. The reconstructed 3D space contributes to a symmetrical and equal observation view for robots and humans, which can be considered a digital twin (DT) environment. The purpose of this study is to enhance the robot skill in the physical workspace, although the artificial intelligence (AI) technique has high performance of the robotic operation in the known environments.
Design/methodology/approach
A multimodal interaction framework is proposed in DT operation environments.
Findings
A fast image-based target segmentation technique is combined in the 3D reconstruction of the robotic operation environment from the eye-to-hand camera, thus expediting the 3D DT environment generation without accuracy loss. A multimodal interaction interface is integrated into the DT environment.
Originality/value
The users are supported to operate the virtual objects in the DT environment using speech, mouse and keyboard simultaneously. The humans’ operations in 3D DT virtual space are recorded, and cues are provided for the robot’s operations in practice.
Isokinetic exercise is considered as one of the most effective ways for rehabilitation and muscle strength enhancement. As rehabilitation equipment, the isokinetic exercise device assists isokinetic movement using a single fixed axis and relevant joint adapters, and it requires high stability and safety performances to cooperate with human. In this paper, a brushless DC motor (BLDCM) was adopted to make a study of isokinetic control. Fractional-order fuzzy PID (FOFPID) controller is an effective controller for the nonlinear system to realize isokinetic control according to reference speed and irregular disturbance (load torque). The model of the BLDCM and FOFPID controller system is built in MATLAB/Simulink to simulate the velocity response of the controller, and a comparison between the FOFPID controller and PID controller is made to verify the system stability.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.