The electrical, magnetic, and structural properties of Sr3(Ru1−xMnx)2O7 (0 ≤ x ≤ 0.2) are investigated. The parent compound Sr3Ru2O7 is a paramagnetic metal, critically close to magnetic order. We have found that, with a Ru-site doping by only a few percent of Mn, the ground state is switched from a paramagnetic metal to an antiferromagnetic insulator. Optical conductivity measurements show the opening of a gap as large as 0.1 eV, indicating that the metal-to-insulator transition is driven by the electron correlation. The complex low-temperature antiferromagnetic spin arrangement, reminiscent of those observed in some nickelates and manganites, suggests a long range orbital order.PACS numbers: 74.70. Pq, 71.27.+a, 71.30.+h The Ruddelson-Popper-type Sr n+1 Ru n O 3n+1 series show metallic properties, as well as exotic superconductivity and spin/orbital order. SrRuO 3 (n = ∞, perovskite) and Sr 4 Ru 3 O 10 (n = 3) are itinerant ferromagnets with Curie temperatures (T c ) around 160 K and 100 K respectively [1,2]. In contrast, the single-layered Sr 2 RuO 4 (n = 1) and double-layered Sr 3 Ru 2 O 7 (n = 2) do not show ferromagnetism (FM). Sr 2 RuO 4 is a well known superconductor, which displays the unconventional spin-triplet pairing [3]. Sr 3 Ru 2 O 7 (Ru 4+ , 4d 4 ) is essentially paramagnetic[4] although there is some controversy in the literature related to the presence of ferromagnetic SrRuO 3 and Sr 4 Ru 3 O 10 impurities. A metamagnetic transition is observed at low temperatures in large magnetic fields [5,6], indicating the presence of quantum criticality. Another signature of this phase competition is found in hydrostatic pressure experiments [8] or Sr-site doping by Ca [7] of Sr 3 Ru 2 O 7 , which stabilizes the antiferromagnetic (AFM) state. In the case of Ca 3 Ru 2 O 7 , which has a lattice structure closely related to that of Sr 3 Ru 2 O 7 , the AFM ordering is observed at low temperature (∼ 56 K). The system remains metallic below this temperature, but near 48 K, a first-order-like transition to a less conductive state is observed [9].In this article, we investigate the effects of the Rusite doping by Mn of Sr 3 Ru 2 O 7 . A metal-to-insulator transition is observed as the Mn content increases. Optical conductivity measurements reveal the opening of a Mott-like gap [10]. Neutron diffraction experiments show that the low temperature insulating state is associated with a novel antiferromagnetic spin arrangement, which suggests some complex orbital order. Interestingly, while there are many observations of insulator-to-metal transitions upon tuning of one-electron bandwidth or bandfilling by doping [11], there are few reports of the opposite, i.e. of the formation of a Mott-like insulating state upon addition of impurities in a metal. One example of such impurity doping effects is found in the Mott insulator V 2 O 3 . As V 3+ is replaced by Ti 3+/4+ , the system becomes metallic by modification of the band filling and/or bandwidth [12]. However, the replacement of V
3+by Cr 3+ instead strengthens the e...