The inorganic perovskite has a better stability than the hybrid halide perovskite, and at the same time it has the potential to achieve an excellent photoelectric performance as the organic-inorganic hybrid halide perovskite. Thus, the pursuit of a low-cost and high-performance inorganic perovskite solar cell (PSC) is becoming the research hot point in the research field of perovskite devices. In setting out to build vacuum-free and carbon-based all-inorganic PSCs with the traits of simple fabrication and low cost, we propose the ones with a simplified vertical structure of FTO/CsPbIBr2/carbon upon interfacial modification with PEI species. In this structure, both the electron-transporting-layer and hole-transporting-layer are abandoned, and the noble metal is also replaced by the carbon paste. At the same time, FTO is modified by PEI, which brings dipoles to decrease the work function of FTO. Through our measurements, the carrier recombination has been partially suppressed, and the performance of champion PSCs has far exceeded the control devices without PEI modification, which yields a power conversion efficiency of 4.9% with an open circuit voltage of 0.9 V and a fill factor of 50.4%. Our work contributes significantly to give an available method to explore charge-transporting-layer-free, low-cost, and high-performance PSCs.