Many medicinal plants around the world are used for therapeutic purposes against several diseases, including diabetes mellitus. Due to their composition of natural substances that are effective and do not represent side effects for users, unlike synthetic drugs, in this study, we investigated the inhibitory effect of Caralluma europaea (CE) on α-glucosidase activity in vitro; then the kinetics of the enzyme were studied with increasing concentrations of sucrose in order to determine the inhibition type of the enzyme. In addition, this effect of Caralluma europaea (CE) was confirmed in vivo using rats as an experimental animal model. Among the five fractions of CE, only the ethyl acetate fraction of C. europaea (EACe) induced a significant inhibition of α-glucosidase and its inhibition mode was competitive. The in vivo studies were conducted on mice and rats using glucose and sucrose as a substrate, respectively, to determine the oral glucose tolerance test (OGTT). The results obtained showed that the EACe and the aqueous extract of C. europaea (AECe) have significantly reduced the postprandial hyperglycemia after sucrose and glucose loading in normal and diabetic rats. AECe, also, significantly decreased intestinal glucose absorption, in situ. The results obtained showed that Caralluma europaea has a significant antihyperglycemic activity, which could be due to the inhibition of α-glucosidase activity and enteric absorption of glucose.