Adaptive Sensitivity Amplification Control of Lower Limb Exoskeletons for Human Performance Augmentation Based on Deep Reinforcement Learning

Zheng, Ranran; Yu, Zhiyuan; Liu, Hongwei; Zhu, Xiaoyan; Zhao, Zhe; Chen, Jing; Zeng, Bo; Liu, Xuliang

doi:10.2139/ssrn.4334510

Cited by 1 publication

(1 citation statement)

References 0 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…DRL has obtained remarkable achievements in the physics-based character animation [41]- [43] and the locomotion control of legged robots [44] such as the quadruped [45]- [49], the biped [50]- [53], and the humanoid [54]- [58], etc. In our previous work [59], the DRL framework is introduced to adapt the sensitivity factors of the primary sensitivity amplification controller to ever-changing HEI dynamics. However, no effort has been made to apply DRL to the development of model-free locomotion controllers for LEHPA systems.…”

Section: Introductionmentioning

confidence: 99%

End-to-End High-Level Control of Lower-Limb Exoskeleton for Human Performance Augmentation Based on Deep Reinforcement Learning

Zheng,

Yu,

Liu

et al. 2023

IEEE Access

View full text Add to dashboard Cite

This paper proposes a novel end-to-end controller for the lower-limb exoskeleton for human performance augmentation (LEHPA) systems based on deep reinforcement learning (E2EDRL). The model-free controller contains two control levels: the high-level control responsible for end-to-end human motion intention recognition based on the exoskeleton state signals and the human-exoskeleton interaction (HEI) force signals by deep neural network predictor, and the lowlevel control for motion tracking by joint PD controllers. The deep neural network predictor does not require complex kinematic calculations that are inevitable in conventional human motion intention recognition methods. We execute the learning process in simulation to learn the E2EDRL strategy efficiently and safely by constructing a novel multibody simulation environment and proposing its specific hybrid inverse-forward dynamics simulation method. The passive mode (all joints remain unpowered) is introduced as a benchmark for comparison purposes. A novel performance assessment method based on HEI forces is put forward to evaluate the E2EDRL strategy quantitatively. The global ratio of the HEI forces in the E2EDRL strategy relative to those in the passive mode is as low as 0.65. The global reduction of the HEI forces demonstrates the superior control performance of the E2EDRL strategy.INDEX TERMS Lower-limb exoskeleton for human performance augmentation, end-to-end human motion intention recognition, deep reinforcement learning

show abstract