Medical image processing is the most challenging and emerging field nowadays. Magnetic Resonance Images (MRI) act as the source for the development of classification system. The extraction, identification and segmentation of infected region from Magnetic Resonance (MR) brain image is significant concern but a dreary and time-consuming task performed by radiologists or clinical experts, and the final classification accuracy depends on their experience only. To overcome these limitations, it is necessary to use computer-aided techniques. To improve the efficiency of classification accuracy and reduce the recognition complexity involves in the medical image segmentation process, we have proposed Threshold Based Region Optimization (TBRO) based brain tumor segmentation. The experimental results of proposed technique have been evaluated and validated for classification performance on magnetic resonance brain images, based on accuracy, sensitivity, and specificity. The experimental results achieved 96.57% accuracy, 94.6% specificity, and 97.76% sensitivity, shows the improvement in classifying normal and abnormal tissues among given images. Detection, extraction and classification of tumor from MRI scan images of the brain is done by using MATLAB software.