A major obstacle in tumor treatment is associated with the poor penetration of a therapeutic agent into the tumor tissue and with their adverse influence on healthy cells, which limits the dose of drug that can be safely administered to cancer patients. Gemcitabine is an anticancer drug used to treat a wide range of solid tumors and is a first-line treatment for pancreatic cancer. The effect of gemcitabine is significantly weakened by its rapid plasma degradation. In addition, the systemic toxicity and drug resistance significantly reduce its chemotherapeutic efficacy. Up to now, many approaches have been made to improve the therapeutic index of gemcitabine. One of the recently developed approaches to improve conventional chemotherapy is based on the direct targeting of chemotherapeutics to cancer cells using the drug-peptide conjugates. In this work, we summarize recently published gemcitabine peptide-based conjugates and their efficacy in anticancer therapy.