A Fine-Tuned Hybrid Stacked CNN to Improve Bengali Handwritten Digit Recognition

Abstract

Recognition of Bengali handwritten digits has several unique challenges, including the variation in writing styles, the different shapes and sizes of digits, the varying levels of noise, and the distortion in the images. Despite significant improvements, there is still room for further improvement in the recognition rate. By building datasets and developing models, researchers can advance state-of-the-art support, which can have important implications for various domains. In this paper, we introduce a new dataset of 5440 handwritten Bengali digit images acquired from a Bangladeshi University that is now publicly available. Both conventional machine learning and CNN models were used to evaluate the task. To begin, we scrutinized the results of the ML model used after integrating three image feature descriptors, namely Binary Pattern (LBP), Complete Local Binary Pattern (CLBP), and Histogram of Oriented Gradients (HOG), using principal component analysis (PCA), which explained 95% of the variation in these descriptors. Then, via a fine-tuning approach, we designed three customized CNN models and their stack to recognize Bengali handwritten digits. On handcrafted image features, the XGBoost classifier achieved the best accuracy at 85.29%, an ROC AUC score of 98.67%, and precision, recall, and F1 scores ranging from 85.08% to 85.18%, indicating that there was still room for improvement. On our own data, the proposed customized CNN models and their stack model surpassed all other models, reaching a 99.66% training accuracy and a 97.57% testing accuracy. In addition, to robustify our proposed CNN model, we used another dataset of Bengali handwritten digits obtained from the Kaggle repository. Our stack CNN model provided remarkable performance. It obtained a training accuracy of 99.26% and an almost equally remarkable testing accuracy of 96.14%. Without any rigorous image preprocessing, fewer epochs, and less computation time, our proposed CNN model performed the best and proved the most resilient throughout all of the datasets, which solidified its position at the forefront of the field.

Machine Learning Methods for Handwriting Recognition

“…CNNs excel at learning hierarchical representations of input data, making them well-suited for image-based tasks like handwriting recognition [28]. In the context of character recognition, CNNs can automatically extract relevant features from images of handwritten text, learning patterns at different levels of abstraction [29].…”

Using Learning Focal Point Algorithm to Classify Emotional Intelligence

“…This research stands at the forefront of these developments, actively contributing to the creation of a state-of-the-art teacher robot that seamlessly integrates [1], [2]. A primary and innovative focus of this endeavor lies in the infusion of emotional intelligence (EI) into robot teachers, achieved through the sophisticated analysis of facial expressions using advanced artificial intelligence techniques [3], [4], [5].…”