We report a vectorial fiber laser with controlled transverse mode conversion by intra-cavity polarization manipulation. By combining a q-plate and two quarter-wave plates (QWPs), we can generate a switchable polarization state output represented by the higher-order Poincaré sphere (l = +1, l = −1), and distinguish the fourfold degenerate LP11 mode. The four transverse vector modes can be obtained and switched in a flexible way, and the slope efficiency of the fiber laser can reach up to 39.4%. This compactness, high efficiency, and switchable operation potential will benefit a range of applications, such as materials processing, particle manipulation, etc.