The aim of this paper is a better understanding for the eigenstates of the asymmetric quantum Rabi model by Lie algebra representations of sl 2 . We define a second order element of the universal enveloping algebra U(sl 2 ) of sl 2 (R), which, through the action of a certain infinite dimensional representation of sl 2 (R), provides a picture of the asymmetric quantum Rabi model equivalent to the one drawn by confluent Heun ordinary differential equations. Using this description, we prove the existence of level crossings in the spectral graph of the asymmetric quantum Rabi model when the symmetry-breaking parameter ǫ is equal to 1 2 , and conjecture a formula that ensures likewise the presence of level crossings for general ǫ ∈ 1 2 Z. This result on level crossings was demonstrated numerically by Li and Batchelor in 2015, investigating an earlier empirical observation by Braak (2011). The first analysis of the degenerate spectrum was given for the symmetric quantum Rabi model by Kuś in 1985. In our picture, we find a certain reciprocity (or Z 2 -symmetry) for ǫ ∈ 1 2 Z if the spectrum is described by representations of sl 2 . We further discuss briefly the non-degenerate part of the exceptional spectrum from the viewpoint of infinite dimensional representations of sl 2 (R) having lowest weight vectors.