The ability to prepare a physical system in a desired quantum state is central to many areas of physics such as nuclear magnetic resonance, cold atoms, and quantum computing. Yet, preparing states quickly and with high fidelity remains a formidable challenge. In this work we implement cutting-edge Reinforcement Learning (RL) techniques and show that their performance is comparable to optimal control methods in the task of finding short, high-fidelity driving protocol from an initial to a target state in non-integrable many-body quantum systems of interacting qubits. RL methods learn about the underlying physical system solely through a single scalar reward (the fidelity of the resulting state) calculated from numerical simulations of the physical system. We further show that quantum state manipulation, viewed as an optimization problem, exhibits a spinglass-like phase transition in the space of protocols as a function of the protocol duration. Our RL-aided approach helps identify variational protocols with nearly optimal fidelity, even in the glassy phase, where optimal state manipulation is exponentially hard. This study highlights the potential usefulness of RL for applications in out-of-equilibrium quantum physics. S = {s = (t, h x (t))}, A = {a = δh x }, R = {r ∈ [0, 1]}.

We present a new open-source Python package for exact diagonalisation and quantum dynamics of spin(-photon) chains, called QuSpin, supporting the use of various symmetries in 1-dimension and (imaginary) time evolution for chains up to 32 sites in length. The package is well-suited to study, among others, quantum quenches at finite and infinite times, the Eigenstate Thermalisation hypothesis, many-body localisation and other dynamical phase transitions, periodically-driven (Floquet) systems, adiabatic and counter-diabatic ramps, and spin-photon interactions. Moreover, QuSpin's user-friendly interface can easily be used in combination with other Python packages which makes it amenable to a high-level customisation. We explain how to use QuSpin using four detailed examples: (i) Standard exact diagonalisation of XXZ chain (ii) adiabatic ramping of parameters in the many-body localised XXZ model, (iii) heating in the periodicallydriven transverse-field Ising model in a parallel field, and (iv) quantised light-atom interactions: recovering the periodically-driven atom in the semi-classical limit of a static Hamiltonian.

Theoretical studies of quantum phase transitions have suggested critical points with higher symmetries than those of the underlying Hamiltonian. Here we demonstrate a surprising emergent symmetry of the coexistence state at a strongly discontinuous phase transition between two ordered ground states. We present a quantum Monte Carlo study of a two-dimensional S = 1/2 quantum magnet hosting the antiferromagnetic (AFM) and plaquette-singlet solid (PSS) states recently detected in SrCu2(BO3)2. We observe that the O(3) symmetric AFM order and the Z2 symmetric PSS order form an O(4) vector at the transition. The control parameter g (a coupling ratio) rotates the vector between the AFM and PSS sectors and there are no energy barriers between the two at the transition point gc. This phenomenon may be observable in SrCu2(BO3)2.

We present a major update to QuSpin, SciPostPhys.2.1.003 -an open-source Python package for exact diagonalization and quantum dynamics of arbitrary boson, fermion and spin many-body systems, supporting the use of various (userdefined) symmetries in one and higher dimension and (imaginary) time evolution following a user-specified driving protocol. We explain how to use the new features of QuSpin using seven detailed examples of various complexity: (i) the transverse-field Ising chain and the Jordan-Wigner transformation, (ii) free particle systems: the Su-Schrieffer-Heeger (SSH) model, (iii) the many-body localized 1D Fermi-Hubbard model, (iv) the Bose-Hubbard model in a ladder geometry, (v) nonlinear (imaginary) time evolution and the Gross-Pitaevskii equation on a 1D lattice, (vi) integrability breaking and thermalizing dynamics in the translationally-invariant 2D transverse-field Ising model, and (vii) out-ofequilibrium Bose-Fermi mixtures. This easily accessible and user-friendly package can serve various purposes, including educational and cutting-edge experimental and theoretical research. The complete package documentation is available under

We give a systematic review of the adiabatic theorem and the leading non-adiabatic corrections in periodically-driven (Floquet) systems. These corrections have a two-fold origin: (i) conventional ones originating from the gradually changing Floquet Hamiltonian and (ii) corrections originating from changing the micro-motion operator. These corrections conspire to give a Hall-type linear response for non-stroboscopic (time-averaged) observables allowing one to measure the Berry curvature and the Chern number related to the Floquet Hamiltonian, thus extending these concepts to periodically-driven many-body systems. The non-zero Floquet Chern number allows one to realize a Thouless energy pump, where one can adiabatically add energy to the system in discrete units of the driving frequency. We discuss the validity of Floquet Adiabatic Perturbation Theory (FAPT) using five different models covering linear and non-linear few and many-particle systems. We argue that in interacting systems, even in the stable high-frequency regimes, FAPT breaks down at ultra slow ramp rates due to avoided crossings of photon resonances, not captured by the inverse-frequency expansion, leading to a counter-intuitive stronger heating at slower ramp rates. Nevertheless, large windows in the ramp rate are shown to exist for which the physics of interacting driven systems is well captured by FAPT.