Reinforcement learning has been widely used in many problems including quantum control of qubits. However, such problems can, at the same time, be solved by traditional, non-machinelearning based methods such as stochastic gradient descendent and Krotov algorithms, and it remains unclear which one is most suitable when the control has specific constraints. In this work we perform a comparative study on the efficacy of two reinforcement learning algorithms, Q-learning and deep Q-learning, as well as stochastic gradient descendent and Krotov algorithms, in the problem of preparing a desired quantum state. We found that overall, the deep Q-learning outperforms others when the problem is discretized, e.g. allowing discrete values of control. The Q-learning and deep Q-learning can also adaptively reduce the complexity of the control sequence, shortening the operation time and improving the fidelity. Our comparison provides insights on the suitability of reinforcement learning in quantum control problems.

One of the ambitious goals of artificial intelligence is to build a machine that outperforms human intelligence, even if limited knowledge and data are provided. Reinforcement Learning (RL) provides one such possibility to reach this goal. In this work, we consider a specific task from quantum physics, i.e. quantum state transfer in a one-dimensional spin chain. The mission for the machine is to find transfer schemes with fastest speeds while maintaining high transfer fidelities. The first scenario we consider is when the Hamiltonian is time-independent. We update the coupling strength by minimizing a loss function dependent on both the fidelity and the speed. Compared with a scheme proven to be at the quantum speed limit for the perfect state transfer, the scheme provided by RL is faster while maintaining the infidelity below 5 × 10 −4 . In the second scenario where a timedependent external field is introduced, we convert the state transfer process into a Markov decision process that can be understood by the machine. We solve it with the deep Q-learning algorithm. After training, the machine successfully finds transfer schemes with high fidelities and speeds, which are faster than previously known ones. These results show that Reinforcement Learning can be a powerful tool for quantum control problems.

Variational quantum‐classical hybrid algorithms are emerging as important tools for simulating quantum chemistry with quantum devices. These algorithms can be applied to evaluate various molecular properties, including potential energy surfaces. Here in, recent progresses on the development of the so‐called variational quantum eigensolver (VQE) are surveyed. The eigensolver aims at reducing the consumption of quantum resources as much as possible. The key feature of VQE is that variation quantum states are optimized by a feedback process, where the measurement of the Hamiltonian is implemented term by term. This approach avoids the need of encoding all of the information about the molecular Hamiltonian in a quantum circuit. The VQE method is also compatible with classical methods in quantum chemistry, such as unitary coupled‐cluster ansatz. Furthermore, basic elements of VQE are covered, such as qubit encoding, mapping rules of the fermionic operators, ansatz preparation, together with several techniques for improving the performance, including constraining, and error mitigation.