High-temperature creep refers to the slow and continuous plastic deformation of materials under the effects of high temperatures and mechanical stress over extended periods, which can lead to the degradation or even failure of the components’ functionality. AlxCr0.2NbTiV (x = 0.2, 0.5, or 0.8) refractory high-entropy alloys were fabricated by arc melting. The effects of Al content on the microstructure of AlxCr0.2NbTiV alloys were studied using X-ray diffraction, scanning electron microscopy, and electron backscatter diffraction. The microhardness, compression properties, and nanoindentation creep properties of AlxCr0.2NbTiV alloys were also tested. The results show that the AlxCr0.2NbTiV series exhibits a BCC single-phase structure. As the Al content increases, the lattice constant of the alloys gradually decreases, and the intensity of the (110) crystal plane diffraction peak increases. Adding aluminum enhances the effect of solution strengthening; however, due to grain coarsening, the microhardness and room temperature compressive strength of the alloy are only slightly improved. Additionally, because the effect of solution strengthening is diminished at high temperatures, the compressive strength of the alloy at 1000 °C is significantly reduced. The creep mechanism of the alloys is predominantly governed by dislocation creep. Moreover, increasing the Al content helps to reduce the sensitivity of the alloy to the loading rate during the creep process. At a loading rate of 2.5 mN/s, the Al0.8Cr0.2NbTiV alloy exhibits the lowest creep strain rate sensitivity index (m), which is 0.0758.