No abstract

We study the reinforcement learning problem of complex action control in the Multi-player Online Battle Arena (MOBA) 1v1 games. This problem involves far more complicated state and action spaces than those of traditional 1v1 games, such as Go and Atari series, which makes it very difficult to search any policies with human-level performance. In this paper, we present a deep reinforcement learning framework to tackle this problem from the perspectives of both system and algorithm. Our system is of low coupling and high scalability, which enables efficient explorations at large scale. Our algorithm includes several novel strategies, including control dependency decoupling, action mask, target attention, and dual-clip PPO, with which our proposed actor-critic network can be effectively trained in our system. Tested on the MOBA game Honor of Kings, the trained AI agents can defeat top professional human players in full 1v1 games.

We present a systematic geometric framework to study closed quantum systems based on suitably chosen variational families. For the purpose of (A) real time evolution, (B) excitation spectra, (C) spectral functions and (D) imaginary time evolution, we show how the geometric approach highlights the necessity to distinguish between two classes of manifolds: Kähler and non-Kähler. Traditional variational methods typically require the variational family to be a Kähler manifold, where multiplication by the imaginary unit preserves the tangent spaces. This covers the vast majority of cases studied in the literature. However, recently proposed classes of generalized Gaussian states make it necessary to also include the non-Kähler case, which has already been encountered occasionally. We illustrate our approach in detail with a range of concrete examples where the geometric structures of the considered manifolds are particularly relevant. These go from Gaussian states and group theoretic coherent states to generalized Gaussian states.

The current proposals for producing non-Abelian anyons and Majorana particles, which are neither fermions nor bosons, are primarily based on the realization of topological superconductivity in two dimensions. We show theoretically that the unique Landau level structure of bilayer graphene provides a new possible avenue for achieving such exotic particles. Specifically, we demonstrate the feasibility of a "parton" fractional quantum Hall (FQH) state, which supports non-Abelian particles without the usual topological superconductivity. Furthermore, we advance this state as the fundamental explanation of the puzzling 1/2 FQH effect observed in bilayer graphene [Kim et al., Nano Lett. 15, 7445 (2015)], and predict that it will also occur in trilayer graphene. We indicate experimental signatures that differentiate the parton state from other candidate non-Abelian FQH states and predict that a transverse electric field can induce a topological quantum phase transition between two distinct non-Abelian FQH states.The discovery of quantum Hall effect in the early 1980s 1,2 ushered in the era of topological phases in modern condensed matter physics. One of the exciting developments it led to was a proposal by Moore and Read 3,4 who modeled the 5/2 fractional quantum Hall (FQH) effect 5 as a topological (chiral p-wave) superconductor of composite fermions 6 , described by either the so-called Pfaffian wave function 3 or its hole conjugate called the anti-Pfaffian wave function 7,8 . They further showed that the vortices of this superconductor bind Majorana zero modes exhibiting non-Abelian braid statistics. The possible application of non-Abelian anyons in topological quantum computation 9,10 has inspired intense experimental effort 11-16 toward testing the non-Abelian nature of the excitations of the 5/2 state. The physics of the 5/2 state also served as a paradigm for proposals of topological superconductivity and Majorana modes in other systems [17][18][19] .This article presents the possibility that bilayer graphene can provide a different route to the realization of non-Abelian particles. To date, high mobility GaAs quantum wells have produced the most extensive FQH states. The atomically thin graphene provides another invaluable system for studying quantum Hall physics. An advantage of FQH states in graphene is its accessibility to direct experimental probes, such as scanning tunneling microscope, which may enable a manipulation of the quasiparticles of FQH states to reveal and perhaps utilize their exotic braid properties. These direct probes are not possible for GaAs quantum wells buried deep below the sample surface. A plethora of FQH states have already been observed in monolayer graphene [20][21][22][23] , which manifest rich patterns due to the SU(4) spin-valley symmetry, but all of them have odd denominators and can be modeled as integer quantum Hall (IQH) states of composite fermions with spin and valley indices 24 . The absence of FQH effect at half filling in any Landau level (LL) of monolayer graphene h...

A versatile and efficient variational approach is developed to solve in- and out-of-equilibrium problems of generic quantum spin-impurity systems. Employing the discrete symmetry hidden in spin-impurity models, we present a new canonical transformation that completely decouples the impurity and bath degrees of freedom. Combining it with Gaussian states, we present a family of many-body states to efficiently encode nontrivial impurity-bath correlations. We demonstrate its successful application to the anisotropic and two-lead Kondo models by studying their spatiotemporal dynamics and universal behavior in the correlations, relaxation times, and the differential conductance. We compare them to previous analytical and numerical results. In particular, we apply our method to study new types of nonequilibrium phenomena that have not been studied by other methods, such as long-time crossover in the ferromagnetic easy-plane Kondo model. The present approach will be applicable to a variety of unsolved problems in solid-state and ultracold-atomic systems.

We provide a detailed formulation of the recently proposed variational approach [Y. Ashida et al., Phys. Rev. Lett. 121, 026805 (2018)] to study ground-state properties and out-of-equilibrium dynamics for generic quantum spin-impurity systems. Motivated by the original ideas by Tomonaga, Lee, Low, and Pines, we construct a canonical transformation that completely decouples the impurity from the bath degrees of freedom. By combining this transformation with a Gaussian ansatz for the fermionic bath, we obtain a family of variational many-body states that can efficiently encode the strong entanglement between the impurity and fermions of the bath. We give a detailed derivation of equations of motions in the imaginary-and real-time evolutions on the variational manifold. We benchmark our approach by applying it to investigate ground-state and dynamical properties of the anisotropic Kondo model and compare results with those obtained using matrix-product state (MPS) ansatz. We show that our approach can achieve an accuracy comparable to MPS-based methods with several orders of magnitude fewer variational parameters than the corresponding MPS ansatz. Comparisons to the Yosida ansatz and the exact solution from the Bethe ansatz are also discussed. We use our approach to investigate the two-lead Kondo model and analyze its long-time spatiotemporal behavior and the conductance behavior at finite bias and magnetic fields. The obtained results are consistent with the previous findings in the Anderson model and the exact solutions at the Toulouse point. * ashida@cat.phys.s.u-tokyo.ac.jp † tshi@itp.ac.cn wherex is the position operator of the impurity andP b is the total momentum operator of bath phonons. After employing the transformation, the conserved quantity becomes the momentum operatorp of the impurity as inferred from the relation:Û † LLP (p +P b )Û LLP =p.(2) arXiv:1802.03861v3 [cond-mat.str-el]

We propose a scheme to realize the Kondo model with tunable anisotropy using alkaline-earth atoms in an optical lattice. The new feature of our setup is Floquet engineering of interactions using time-dependent Zeeman shifts, that can be realized either using state-dependent optical Stark shifts or magnetic fields. The properties of the resulting Kondo model strongly depend on the anisotropy of the ferromagnetic interactions. In particular, easy-plane couplings give rise to Kondo singlet formation even though microscopic interactions are all ferromagnetic. We discuss both equilibrium and dynamical properties of the system that can be measured with ultracold atoms, including the impurity spin susceptibility, the impurity spin relaxation rate, as well as the equilibrium and dynamical spin correlations between the impurity and the ferromagnetic bath atoms. We analyze the non-equilibrium time evolution of the system using a variational non-Gaussian approach, which allows us to explore coherent dynamics over both short and long timescales, as set by the bandwidth and the Kondo singlet formation, respectively. In the quench-type experiments, when the Kondo interaction is suddenly switched on, we find that real-time dynamics shows crossovers reminiscent of poor man's renormalization group flow used to describe equilibrium systems. For bare easy-plane ferromagnetic couplings, this allows us to follow the formation of the Kondo screening cloud as the dynamics crosses over from ferromagnetic to antiferromagnetic behavior. On the other side of the phase diagram, our scheme makes it possible to measure quantum corrections to the well-known Korringa law describing the temperature dependence of the impurity spin relaxation rate. Theoretical results discussed in our paper can be measured using currently available experimental techniques. arXiv:1801.01132v1 [cond-mat.quant-gas]

Within the framework of the Gaussian-state theory, we show that the quantum many-body ground state of a trapped condensate with weakly attractive interaction is a single-mode squeezed vacuum state, as oppose to the coherent state under repulsive interaction. The spatial mode of the squeezedstate condensates satisfies a Gross-Pitaevskii like equation in which the interaction strength is augmented by a factor 3 due to the large particle fluctuation of the squeezed state. We also study the collective excitations of the condensates by the tangential space projection, which leads to new two-particle excitations and confirms the phase transition from coherent-state to squeezed-state condensates. Our investigation clarifies the quantum states of the attractive condensates and will shed new light on research of the droplet phases in dipolar and multicomponent condensates.