“…Many real-life problems such as games (Jordan et al, 2010;Amato and Shani, 2010), robotics (Spaan and Melo, 2008), traffic light control (Mohammadian, 2006;Le and Cai, 2010) or air traffic (Sislak et al, 2008;Dimitrakiev et al, 2010), occur in dynamic environments. Agents that interact in this kind of environment need techniques to help them, e.g., to reach some goal, to solve a problem or to improve performance.…”