“…In this study, we will combine the models used to summarize, namely the transformer or T5 model with the convolutional Seq2Seq model. Several related studies such as those conducted by Fendji (Fendji et al, 2021) conducted summaries on French Wikipedia documents by applying the T5 model, the T5 model has several advantages in generating text so many researchers use the T5 model in conducting summaries as did Chouikhi (Chouikhi & Alsuhaibani, 2022), Jung (Jung et al, 2022), and Quatra (La Quatra & Cagliero, 2022). In many studies in conducting abstract summaries, there are challenges such as unstructured text which must be changed with text preprocessing techniques such as those carried out by Widyassari (Widyassari et al, 2022) and Christian (Christian et al, 2016) utilizing text preprocessing techniques to be used for document summary processes.…”