“…q 12 = q 3 . However, for x 1 = ( s , q 1 , T ) and x 2 = ( s , q 2 , T ), we have Φ (x 1 ) = 0 and Φ (x 2 ) = 0 if the corresponding automaton component has not been visited yet (i.e., q 1 , q 2 still in T Φ ) by ( 17) and (18). For instance, given a run x = ( s , q 0 , T ) u P 0 ( s , q 1 , T ) u P 1 ( s , q 2 , T ) u P 2 ( s , q 3 , T ) , the associated shaped reward for each transition is R ( s , q 0 , T ) , u P 0 , ( s , q…”