“…Various successful cases, especially in robot controlling, intelligence driving and games, bring it to a wider world to address complex control issues. The combination of RL and optics, ranging from adaptive optics, 1, 2 structural color, 3 to optical design, [4][5][6] has also attracted the researchers' attention. Notably, in these cases, the RL agent usually interacts with the optical system directly.…”