Since the second industrial revolution, the use of fossil fuels has been powering the advance of human society. However, the surge in carbon dioxide (CO2) emissions has raised unsettling concerns about global warming and its consequences. Membrane separation technologies have emerged as one of the major carbon reduction approaches because they are less energy-intensive and more environmentally friendly compared to other separation techniques. Compared to pure polymeric membranes, mixed matrix membranes (MMMs) that encompass both a polymeric matrix and molecular sieving fillers have received tremendous attention, as they have the potential to combine the advantages of both polymers and molecular sieves, while cancelling out each other’s drawbacks. In this review, we will discuss recent advances in the development of MMMs for CO2 separation. We will discuss general mechanisms of CO2 separation in an MMM, and then compare the performances of MMMs that are based on zeolite, MOF, metal oxide nanoparticles and nanocarbons, with an emphasis on the materials’ preparation methods and their chemistries. As the field is advancing fast, we will particularly focus on examples from the last 5 years, in order to provide the most up-to-date overview in this area.