Thin-walled bars with an open cross-section are widely used in mechanical structures where weight and size control are particularly required. Thus, this paper attempts to propose a theoretical model for predicting the mechanical properties of a thin-walled bar with an open cross-section under restrained torsion. Firstly, a theoretical model with predictions of shear stress, buckling normal stress, and secondary shear stress of the thin-walled bar with open cross-section under the condition of restrained torsion was developed based on torsion theory. Then, physical test and finite element modeling data were employed to validate the theoretical predictions. The results indicate that the theoretical predictions show good agreements with data of finite element modeling and experiments. Therefore, the proposed theoretical model could be used for the prediction of the mechanical response of a thin-walled bar with an open annular section under restrained torsion.