Gestational diabetes mellitus is a more common complication in pregnancy and rising worldwide and screening for treating gestational diabetes mellitus is an opportunity for preventing its complications. Abnormal body mass index is the cause of many complications in pregnancy that is one of the major and modifiable risk factors in pregnancy too. This systematic review aimed to define the association between body mass index in the first half of pregnancy (before 20 weeks of gestation) and gestational diabetes mellitus. Web of Science, PubMed/Medline, Embase, Scopus, ProQuest, Cochrane library, and Google Scholar databases were systematically explored for articles published until April 31, 2022. Participation, exposure, comparators, outcomes, study design criteria include pregnant women (P), body mass index (E), healthy pregnant women (C), gestational diabetes mellitus (O), and study design (cohort, case–control, and cross-sectional). Newcastle–Ottawa scale checklists were used to report the quality of the studies. Eighteen quality studies were analyzed. A total of 41,017 pregnant women were in the gestational diabetes mellitus group and 285,351 pregnant women in the normal glucose tolerance group. Studies have reported an association between increased body mass index and gestational diabetes mellitus. Women who had a higher body mass index in the first half of pregnancy were at higher risk for gestational diabetes mellitus. In the first half of pregnancy, body mass index can be used as a reliable and available risk factor to assess gestational diabetes mellitus, especially in some situations where the pre-pregnancy body mass index is not available.