Spin echo is a powerful technique to extend atomic or nuclear coherence time by overcoming the dephasing due to inhomogeneous broadening. However, applying this technique to an ensemblebased quantum memory at single-quanta level remains challenging. In our experimental study we find that noise due to imperfection of the rephasing pulses is highly directional. By properly arranging the beam directions and optimizing the pulse fidelities, we have successfully managed to operate the spin echo technique in the quantum regime and observed nonclassical photon-photon correlations. In comparison to the case without applying the rephasing pulses, quantum memory lifetime is extended by 5 folds. Our work for the first time demonstrates the feasibility of harnessing the spin echo technique to extend lifetime of ensemble-based quantum memories at single-quanta level. In an atomic-ensemble quantum memory, inhomogeneous broadening due to ambient magnetic field, atomic random motion and interaction with host spins etc. severely limits the storage time [12,13]. One universal solution to overcome inhomogeneous broadening induced decoherence is to make use of the spin echo technique [14], where a series of π pulses are applied to reverse the phase evolution through population inversion. This technique has been widely used in storage of classical light pulses. For example, with the spin echo technique, the storage lifetime has been extended to second and minute regime in solid-state ensembles and atomic-gas ensembles, respectively [15,16]. However, whether this technique is applicable to the storage of quantum light or photons has not been resolved yet experimentally. The main concern [17,18] is that since the π pulses induce population inversion, tiny imperfection of them could result in background noises which are much stronger than the stored single-photon signals.In this letter we experimentally study the spin echo process of single excitations in a cold-atomic-gas quantum memory by employing stimulated Raman transitions. We find that the noise due to imperfection of the π pulses is highly directional. In our experiment, by carefully arranging the Raman-beam directions and optimizing the pulse fidelities, we have successfully reduced this noise to much lower than the single-photon signal. Quantum nature of the spin echo process is verified by observing nonclassical photon-photon correlations. In our demonstration, the distorted spin-wave state gets rephased by applying two π pulses and the quantum memory lifetime is increased by 5 folds. Our findings and techniques developed is applicable to all other ensemblebased quantum memories [1].In an atomic-ensemble quantum memory, a single quantum state is stored as a spin wave spreading over the whole ensemble [19,20]. The spin-wave state at t = 0 can be described aswhere N is the number of atoms, |g and |s are two atomic ground states, k s is the wavevector of the spin wave, r j (0) is the position of the j-th atom in the ensemble at t = 0. This state can be physically interpreted as...