Backgrounds: Immune checkpoint inhibitors (ICIs) alone or in combination with chemotherapy (CT) are the standard of care for first-line therapy in metastatic non-small cell lung cancer (NSCLC) patients without actionable mutations. The safety ranking of different ICI and CT combination regimens has not been investigated. This study was aimed to provide a toxicity profile and safety ranking of different ICI and CT combination regimens.Methods: We performed comprehensive searches of phase 2 and 3 randomized clinical trials (RCTs) comparing different ICI regimens (alone or combination) or CT for the first-line treatment of advanced NSCLC. Outcomes of interest were the cumulative incidence of any treatment-related adverse events (TRAEs), grade 3-5 TRAEs (grade 3-5), any immune-related adverse events (irAEs), and grade 3-5 irAEs (grade 3-5). Odds ratios and 95% credible intervals were calculated as summary statistics to quantify the effect of different ICI combination regimens. Results: We included 23 RCTs from 2016 to 2021 with a total of 14,378 patients. The incidence of any TRAEs and grade 3-5 TRAEs ranked from high to low were ICI-CT (probability: 74.88%), ICI-ICI-CT (50.60%), CT alone (74.79%), ICI-ICI (98.37%), and ICI monotherapy (99.37%). Adding CT to ICI regimens resulted in a higher incidence of any grade or grade 3-5 TRAEs compared to ICI-ICI combinations or ICI monotherapy. However, ICI-ICI-CT combinations did not result in a higher incidence of TRAEs than ICI-CT combinations. For any irAEs and grade 3-5 irAEs, the ranking was ICI-ICI (probability: 97.38), ICI monotherapy (96.98%), ICI-CT (99.44%), and CT alone (99.98%). Notably, the incidence of any grade and grade 3-5 irAEs was lower when adding CT to ICI monotherapy. Conclusion: Lack of head-to-head comparisons, these findings provide evidence for clinical decision-making when considering different ICI combination regimens for advanced NSCLC patients.