Transfer Learning to Predict Genre Based on Anime Posters

Abstract

Anime is an animated film with a distinctive graphic design originating from Japan, which is widely favored by various groups. anime itself has a genre like a movie in general, but there is a slight difference from ordinary films, anime has additional genres that are not in ordinary films, such as the Ecchi, Mahou Shoujou, Seinen, Shounen, and Josei genres. Since those genres only exist in anime, this research is devoted to predicting those anime genres. The prediction will use posters from the anime itself, with the help of image processing, namely the Convolutional Neural Network method and Transfer Learning. Transfer Learning will be implanted as a comparison of the performance of the existing architecture with the architecture that will be created, whether the architecture is able to process the dataset properly. The dataset to be used is a dataset of posters and csv documents containing images and details of the anime, the dataset contains anime data from 1980 to 2021 and contains 11651 anime poster data which has different resolution sizes. The ResNet50 model has the highest accuracy rate of 48% with a loss rate of 36%, while InceptionV3 produces 35% accuracy with 69% loss. At the time of testing ResNet50 gave the smallest genre percentage value of CustomModel and InceptionV3, while CustomModel gave the highest genre value. In addition to the value, all modes also predicted the genre well. Especially InceptionV3 is able to predict the music genre, because the music genre has a very small number of datasets, and this music genre is difficult to predict by the ResNet50 and CustomModel models.