Benzophenone-3 (BP-3) is one of the most widely used chemical sunscreens. The results of many in vitro and in vivo tests confirm its high percutaneous penetration and systemic absorption, which question the safety of its wide use. The aim of our research was to assess the effect of this compound on components of the skin extracellular matrix, and to investigate whether rosmarinic acid (RA) could reduce BP-3-induced changes in human skin fibroblasts. BP-3 used at concentrations of 0.1–100 µM caused a number of unfavorable changes in the level of type I collagen, decorin, sulfated glycosaminoglycans, hyaluronic acid, elastin, and expression or activity of matrix metalloproteinases (MMP-1, MMP-2), elastase and hyaluronidase. Moreover, the intracellular retention of collagen was accompanied by changes in the expression of proteins modifying and controlling the synthesis and secretion of this protein. Most importantly, RA at a concentration of 100 µM significantly reduced or completely abolished the adverse effects of BP-3. Based on these findings, it can be concluded that this polyphenol may provide effective protection against BP-3-induced disturbances in skin cells, which may have important clinical implications.