This paper shows how Q-learning approach can be used in a successful way to deal with the problem of mobile robot navigation. In real situations where a large number of obstacles are involved, normal Q-learning approach would encounter two major problems due to excessively large state space. First, learning the Q-values in tabular form may be infeasible because of the excessive amount of memory needed to store the table. Second, rewards in the state space may be so sparse that with random exploration they will only be discovered extremely slowly. In this paper, we propose a navigation approach for mobile robot, in which the prior knowledge is used within Q-learning. We address the issue of individual behavior design using fuzzy logic. The strategy of behaviors based navigation reduces the complexity of the navigation problem by dividing them in small actions easier for design and implementation. The Q-Learning algorithm is applied to coordinate between these behaviors, which make a great reduction in learning convergence times. Simulation and experimental results confirm the convergence to the desired results in terms of saved time and computational resources. Keywords Mobile robot, behaviors based navigation, fuzzy logic and reinforcement learning.

No abstract

No abstract

This paper presents the design procedure of a biomechanical leg, with a passive toe joint, which is capable of mimicking the human walking. This leg has to provide the major features of human gait in the motion trajectories of the hip, knee, ankle, and toe joints. Focus was given to the approach of designing the passive toe joint of the biomechanical leg in its role and effectiveness in performing human like motion. This study was inspired by experimental and theoretical studies in the fields of biomechanics and robotics. Very light materials were mainly used in the design process. Aluminum and carbon fiber parts were selected to design the proposed structure of this biomechanical leg, which is to be manufactured in the Mechanical Lab of the Sultan Qaboos University (SQU). The capabilities of the designed leg to perform the normal human walking are presented. This study provides a noteworthy and unique design for the passive toe joint, represented by a mass-spring damper system, using torsion springs in the foot segment. The working principle and characteristics of the passive toe joint are discussed. Four-designed cases, with different design parameters, for the passives toe joint system are presented to address the significant role that the passive toe joint plays in human-like motion. The dynamic motion that is used to conduct this comparison was the first stage of the stance motion. The advantages of the presence of the passive toe joint in gait, and its effect on reducing the energy consumption by the other actuated joints are presented and a comparison between the four-designed cases is discussed.

No abstract