Even though nanoparticle drug delivery systems (nanoDDSs) have improved antitumor efficacy by delivering more drugs to tumor sites compared to free and unencapsulated therapeutics, achieving satisfactory distribution and penetration of nanoDDSs inside solid tumors, especially in stromal fibrous tumors, remains challenging. As one of the most common stromal cells in solid tumors, tumor-associated fibroblasts (TAFs) not only promote tumor growth and metastasis but also reduce the drug delivery efficiency of nanoparticles through the tumor’s inherent physical and physiological barriers. Thus, TAFs have been emerging as attractive targets, and TAF-targeting nanotherapeutics have been extensively explored to enhance the tumor delivery efficiency and efficacy of various anticancer agents. The purpose of this Review is to opportunely summarize the underlying mechanisms of TAFs on obstructing nanoparticle-mediated drug delivery into tumors and discuss the current advances of a plethora of nanotherapeutic approaches for effectively targeting TAFs.