We report magnetic quantum oscillations measured using torque magnetisation in the Kondo insulator YbB and discuss the potential origin of the underlying Fermi surface. Observed quantum oscillations as well as complementary quantities such as a finite linear specific heat capacity in YbB exhibit similarities with the Kondo insulator SmB, yet also crucial differences. Small heavy Fermi sections are observed in YbB with similarities to the neighbouring heavy fermion semimetallic Fermi surface, in contrast to large light Fermi surface sections in SmB which are more similar to the conduction electron Fermi surface. A rich spectrum of theoretical models is suggested to explain the origin across different Kondo insulating families of a bulk Fermi surface potentially from novel itinerant quasiparticles that couple to magnetic fields, yet do not couple to weak DC electric fields.

A central question in the underdoped cuprates pertains to the nature of the pseudogap ground state. A conventional metallic ground state of the pseudogap region has been argued to host quantum oscillations upon destruction of the superconducting order parameter by modest magnetic fields. Here, we use low applied measurement currents and millikelvin temperatures on ultrapure single crystals of underdoped YBa2Cu3O6+x to unearth an unconventional quantum vortex matter ground state characterized by vanishing electrical resistivity, magnetic hysteresis, and nonohmic electrical transport characteristics beyond the highest laboratory-accessible static fields. A model of the pseudogap ground state is now required to explain quantum oscillations that are hosted by the bulk quantum vortex matter state without experiencing sizable additional damping in the presence of a large maximum superconducting gap; possibilities include a pair density wave.

Summary The finding of bulk quantum oscillations in the Kondo insulator SmB 6 proved a considerable surprise. Subsequent measurements of bulk quantum oscillations in other correlated insulators including YbB 12 lent support to our discovery of a class of bulk unconventional insulators that host bulk quantum oscillations. Here we perform a series of experiments to examine evidence for the intrinsic character of bulk quantum oscillations in floating zone-grown single crystals of SmB 6 that have been the subject of our quantum oscillation studies. We present results of thermodynamic, transport, and composition analysis experiments on pristine floating zone-grown single crystals of SmB 6 and compare quantum oscillations with metallic LaB 6 and elemental aluminum. These results establish the intrinsic origin of quantum oscillations from the insulating bulk of floating zone-grown SmB 6 . The similarity of the Fermi surface in insulating SmB 6 with the conduction-electron Fermi surface in metallic hexaborides is at the heart of a theoretical mystery.

The nature of the Fermi surface observed in the recently discovered family of unconventional insulators starting with SmB6 is a subject of intense inquiry. Here we shed light on this question by accessing quantum oscillations in the high magnetic field-induced metallic regime above ≈47 T in YbB12, which we compare with the unconventional insulating regime. In the field-induced metallic regime, we find prominent quantum oscillations in the electrical resistivity characterised by multiple frequencies and heavy effective masses. The close similarity in Lifshitz-Kosevich low-temperature growth of quantum oscillation amplitude in insulating YbB12 to field-induced metallic YbB12, points to an origin of quantum oscillations in insulating YbB12 from in-gap neutral low energy excitations. Higher frequency Fermi surface sheets of heavy quasiparticle effective mass emerge in the field-induced metallic regime of YbB12 in addition to multiple heavy Fermi surface sheets observed in both insulating and metallic regimes. f-electron hybridisation is thus observed to persist from the unconventional insulating to the field-induced metallic regime of YbB12, in contrast to the unhybridised conduction electron Fermi surface observed in unconventional insulating SmB6. Our findings thus require an alternative model for YbB12, of neutral in-gap low energy excitations, wherein the f-electron hybridisation is retained.

No abstract