A Comprehensive Study on Torchvision Pre-trained Models for Fine-grained Inter-species Classification

Abstract

This study aims to explore different pre-trained models offered in the Torchvision package which is available in the PyTorch library. And investigate their effectiveness on finegrained images classification. Transfer Learning is an effective method of achieving extremely good performance with insufficient training data. In many real-world situations, people cannot collect sufficient data required to train a deep neural network model efficiently. Transfer Learning models are pre-trained on a large data set, and can bring a good performance on smaller datasets with significantly lower training time. Torchvision package offers us many models to apply the Transfer Learning on smaller datasets. Therefore, researchers may need a guideline for the selection of a good model. We investigate Torchvision pretrained models on four different data sets: 10 Monkey Species, 225 Bird Species, Fruits 360, and Oxford 102 Flowers. These data sets have images of different resolutions, class numbers, and different achievable accuracies. We also apply their usual fullyconnected layer and the Spinal fully-connected layer to investigate the effectiveness of SpinalNet. The Spinal fully-connected layer brings better performance in most situations. We apply the same augmentation for different models for the same data set for a fair comparison. This paper may help future Computer Vision researchers in choosing a proper Transfer Learning model.

Epileptic Seizures Detection in EEG Signals Using Fusion Handcrafted and Deep Learning Features

“…Then, these 2 D images are applied to different 2D deep learning networks. Another future work is using novel DL techniques such as attention learning [119][120][121][122], transformers [123,124], and other advanced deep learning techniques [125][126][127][128][129][130][131][132][133][134] for epileptic seizure detection. Finally, adopting novel deep feature fusion techniques to epileptic seizures detection based on EEG signals can be noteworthy as one of the future works [135].…”