runs, using the TRANSYT-7F simulation engine. Each simulation run is assigned a unique signal timing plan by the optimization processor. The optimizer applies the Hill-Climbing (HC) or Genetic Algorithm (GA) searching strategies. The trial simulation run resulting in the best performance is reported as optimal. Although the GA is mathematically better suited for determining the absolute or global optimal solution, relative to HC optimization, it generally requires longer program running times, relative to HC optimization [4]. This chapter proposes Ant Colony Optimization (ACO) based algorithm called ACORSES proposed by [5] for finding optimum signal parameters in coordinated signalized networks for given fixed set of link flows. The ACO is the one of the most recent techniques for approximate optimization methods. The main idea is that it is indirect local communication among the individuals of a population of artificial ants. The core of ant's behaviour is the communication between the ants by means of chemical pheromone trails, which enables them to find shortest paths between their nest and food sources. This behaviour of real ant colonies is exploited to solve optimization problems. The proposed algorithm is based on each ant searches only around the best solution of the previous iteration with reduced search space. It is proposed for improving ACO's solution performance to reach global optimum fairly quickly. In this study, for solving the ATC problem, Ant Colony Optimization TRANSYT (ACOTRANS) model is developed. TRANSYT-7F traffic model is used to estimate total network PI.
A novel approach to optimizing any given mathematical function, called the MOdified REinforcement Learning Algorithm (MORELA), is proposed. Although Reinforcement Learning (RL) is primarily developed for solving Markov decision problems, it can be used with some improvements to optimize mathematical functions. At the core of MORELA, a sub-environment is generated around the best solution found in the feasible solution space and compared with the original environment. Thus, MORELA makes it possible to discover global optimum for a mathematical function because it is sought around the best solution achieved in the previous learning episode using the sub-environment. The performance of MORELA has been tested with the results obtained from other optimization methods described in the literature. Results exposed that MORELA improved the performance of RL and performed better than many of the optimization methods to which it was compared in terms of the robustness measures adopted.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.