Image Classification Using Deep and Classical Machine Learning on Small Datasets: A Complete Comparative

Miranda, Gonzalo; Rubio-Manzano, Clemente

doi:10.20944/preprints202201.0367.v1

Cited by 2 publications

(1 citation statement)

References 1 publication

(1 reference statement)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Furthermore, reducing model complexity may limit the model's ability to learn from high-dimensional data, which can lead to poorer performance in tasks such as medical images or speech recognition. Therefore, it is crucial to carefully balance the trade-offs between model complexity and model performance on both the training and test data [448][449][450][451].…”

Section: Model Architecturementioning

confidence: 99%

A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications

et al. 2023

View full text Add to dashboard Cite

Data scarcity is a major challenge when training deep learning (DL) models. DL demands a large amount of data to achieve exceptional performance. Unfortunately, many applications have small or inadequate data to train DL frameworks. Usually, manual labeling is needed to provide labeled data, which typically involves human annotators with a vast background of knowledge. This annotation process is costly, time-consuming, and error-prone. Usually, every DL framework is fed by a significant amount of labeled data to automatically learn representations. Ultimately, a larger amount of data would generate a better DL model and its performance is also application dependent. This issue is the main barrier for many applications dismissing the use of DL. Having sufficient data is the first step toward any successful and trustworthy DL application. This paper presents a holistic survey on state-of-the-art techniques to deal with training DL models to overcome three challenges including small, imbalanced datasets, and lack of generalization. This survey starts by listing the learning techniques. Next, the types of DL architectures are introduced. After that, state-of-the-art solutions to address the issue of lack of training data are listed, such as Transfer Learning (TL), Self-Supervised Learning (SSL), Generative Adversarial Networks (GANs), Model Architecture (MA), Physics-Informed Neural Network (PINN), and Deep Synthetic Minority Oversampling Technique (DeepSMOTE). Then, these solutions were followed by some related tips about data acquisition needed prior to training purposes, as well as recommendations for ensuring the trustworthiness of the training dataset. The survey ends with a list of applications that suffer from data scarcity, several alternatives are proposed in order to generate more data in each application including Electromagnetic Imaging (EMI), Civil Structural Health Monitoring, Medical imaging, Meteorology, Wireless Communications, Fluid Mechanics, Microelectromechanical system, and Cybersecurity. To the best of the authors’ knowledge, this is the first review that offers a comprehensive overview on strategies to tackle data scarcity in DL.

show abstract

Section: Model Architecturementioning

confidence: 99%

A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications

et al. 2023

View full text Add to dashboard Cite

show abstract

Unet-boosted Classifier – Multi-Task Architecture for Small Datasets Applied to Brain MRI Classification

Sobyanin,

Kulikova

2024

View full text Add to dashboard Cite

The problem of training deep neural networks on small samples is especially relevant for medical issues. The paper examines the impact of pixel-wise marking of significant objects in the image, over the true class label, on the quality of the classification. To achieve better classification results on small samples, we propose a multitasking architecture – Unet-boosted classifier (UBC), that is trained simultaneously to solve classification and semantic segmentation problems. As the exploratory dataset, MRI images of patients with benign glioma and glioblastoma taken from the BRaTS 2019 data set are used. One horizontal slice of the MRI image containing a glioma is considered as the input (a total of 380 frames in the training set), and the probability of glioblastoma – as the output. Resnet34 was chosen as the baseline, trained without augmentations with a loss function based on cross-entropy. As an alternative solution, UBC-resnet34 is used – the same resnet34, boosted by a decoder built on the U-Net principle and predicting the pixels with glioma. The smoothed Sorensen-Dice coefficient (DiceLoss) is used as a decoder loss function. Results on the test sample: accuracy for the baseline reached 0.71, for the proposed model – 0.81, and the Dice score – 0.77. Thus, a deep model can be well trained even on a small data set, using the proposed architecture, provided that marking of the affected tissues in the form of a semantic mask is provided.

show abstract

Image Classification Using Deep and Classical Machine Learning on Small Datasets: A Complete Comparative

Cited by 2 publications

References 1 publication

A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications

A survey on deep learning tools dealing with data scarcity: definitions, challenges, solutions, tips, and applications

Unet-boosted Classifier – Multi-Task Architecture for Small Datasets Applied to Brain MRI Classification

Contact Info

Product

Resources

About