We report on a 10-watt-level, efficient 2 μm Ho:YAG (0.6 at.% Ho3+ doped Y3Al5O12) single crystal fiber (SCF) laser in-band pumped by a 1.9 μm laser diode. Benefiting from the high gain of the SCF and the unique propagation features of the pump and laser beams, a maximum output power of 10.77 W is achieved with T
OC = 20%, corresponding to a slope efficiency of 61.8%. The higher efficiency of 64.8% and the output power of 9.8 W are obtained with T
OC = 50%. Compared to the traditional bulk crystal, wave-guiding of the pump light in the SCF can extend the gain region and thus improve the laser efficiency, which provides a simple and effective method to improve the utilization rate of the pump light even for the low-brightness laser diodes.