?
Evolution of surface conductivity in SmB6 under nonmagnetic (Yb2+) and magnetic (Eu2+) doping
Among of rare-earth (RE) hexaborides only two compounds SmB6 and YbB6 are discussed in literature to be
members of a new class of 3D topological insulators. However, their ground states originate due to different
physical mechanisms, including Kondo 4f-5d hybridization and 5d-2p band inversion, respectively. Here we
report a comparative study of magnetotransport (resistivity and transverse magnetoresistance) measured on high
quality single crystals of YbxSm1-xB6 and EuxSm1-xB6 solid solutions (x ≤ 0.05) at temperatures 1.7 − 300 K in
magnetic fields up to 82 kOe. The choice of dopant was determined by the fact that the presence of magnetic/
nonmagnetic (Eu2+/Yb2+) impurity in parent SmB6 matrix should lift/not lift the topological protection of
surface states. Based on the two-gap paradigm the x-evolution of electron spectra in YbxSm1-xB6 and EuxSm1-xB6
was studied. Our data show that both the 4f lattice coherence (Eg) and the intrinsic gap (Ea) related to many-body
states survive under RE doping at least for x ≈ 0.02 − 0.024. We also suggest that the point x(Eu) = 0.05 can be
treated as an upper limit of the small gap closing in EuxSm1-xB6 materials. In YbxSm1-xB6 family a negative linear
transverse magnetoresistance (TMR) was detected for the first time in the regime of surface conductivity (T < T*
≈ 5 K). The TMR anomaly at T* caused possibly by the topological protection of surface states in SmB6 is found to
survive in Eu-doped compounds but disappears almost completely for Yb-doped compositions in the same fixed
magnetic fields. This paradoxical observation is not consistent with general predictions of the topological Kondo
insulator (TKI) model.