Nowadays, brain tumor (BT), which is the abnormal growth of the mass of tissues in the human brain, is the main cause of death among kids and adults. The existing methodologies concentrate only on the BT classification and could not detect the BT size. This work proposes to detect the BT size utilizing Modified Deep Learning (MDNN) and multilevel thresholding (MT) utilizing modified dragonfly optimization (MD‐MT) algorithm. Afterward, the Histogram Clipping (HC)‐based Contrast Limited Adaptive Histogram Equalization (CLAHE) approach is implemented for enhancing the contrast of the inputted image, and certain features are extracted as of those contrast‐enhanced images. Next, the image is classified as (i) tumor image and (ii) nontumor image with the aid of MDNN. The tumor part is segmented as the classified tumor affected image utilizing MD‐MT. Here, the proposed HC‐CLAHE attains a 99.74% Spearman Rank Correlation, which is greater among other methods while the proposed MD‐MT attains a higher accuracy (99.73%). For classification, the proposed MDNN and the existing Artificial Neural Network, K‐Nearest Neighbor, Support Vector Machine, and Naïve Bayes are contrasted grounded on their performance in respect of precision, f‐measure, and recall. The proposed work shows excellent performance during the experimental evaluation.