We study the quantum nonequilibrium dynamics of ultracold three-level atoms trapped in an optical lattice, which are excited to their Rydberg states via a two-photon excitation with nonnegligible spontaneous emission. Rich quantum phases including uniform phase, antiferromagnetic phase and oscillatory phase are identified. We map out the phase diagram and find these phases can be controlled by adjusting the ratio of intensity of the pump light to the control light, and that of two-photon detuning to the Rydberg interaction strength. When the two-photon detuning is blue-shifted and the latter ratio is less than 1, bistability exists among the phases. Actually, this ratio controls the Rydberg-blockade and antiblockade effect, thus the phase transition in this system can be considered as a possible approach to study both effects. Introduction: Rydberg atoms with principal quantum number n ≫ 1 have exaggerated atomic properties including strong dipole-dipole interactions and long radiative lifetimes [1]. These properties are attractive for quantum information processing [2,3] and quantum many-body dynamics simulation [4,5]. Most of these researches require a negligible spontaneous emission for reducing the quantum decoherence [6]. However, a recent research shows that when spontaneous emission is significant, quantum nonequilibrium dynamics could be demonstrated using Rydberg atom gases [7]. The system investigated is like a spin-1/2 particle system, which undergoes a phase transition from a spatially uniform phase to an antiferromagnetic phase by tuning the laser frequency as shown in Ref. [7]. Moreover, the nonequilibrium induced by the spontaneous emission leads to an oscillatory phase. Further research has found collective quantum jump between a state of low Rydberg population and a state of high Rydberg population [8]. These researches open up a new window to use Rydberg atoms for quantum nonequilibrium dynamics simulation [9].When two atoms are close, the excitation of one atom is prohibited by an already excited neighboring atom due to the level shift by the strong dipole-dipole interaction at a short distance [10]. This phenomenon is called dipole blockade effect and has played an important role in current Rydberg atom researches [11][12][13]. However, recent theoretical and experimental investigations have shown that in a three-level two-photon Rydberg excitation scheme, there also exists antiblockade effect due to the Aulter-Townes splitting induced by the lower transition [14,15]. The possibility of enhancing the antiblockade effect by trapping atoms within a lattice has been proposed [15]. So far, the exploration of physical effect of the coexistence of blockade effect and antiblockade effect on quantum dynamics of Rydberg atom gases in this two-step excitation scheme still remains at its early stage.In this paper, we propose to study the quantum nonequilibrium dynamics of three-level atoms trapped within a lattice via a two-step excitation. Adopting the mean field approach used in Ref. [7], we predict t...