Magnetic resonance image (MRI) segmentation refers to a process of assigning labels to set of pixels or multiple regions. It plays a major role in the field of biomedical applications as it is widely used by the radiologists to segment the medical images input into meaningful regions. In recent years, various brain tumor detection techniques are presented in the literature. In this article, we have developed an approach to brain tumor detection and severity analysis is done using the various measures. The proposed approach comprises of preprocessing, segmentation, feature extraction, and classification. In preprocessing steps, we need to perform skull stripping and then, anisotropic filtering is applied to make image suitable for extracting features. In feature extraction, we have modified the multi‐texton histogram (MTH) technique to improve the feature extraction. In the classification stage, the hybrid kernel is designed and applied to training of support vector machine to perform automatic detection of tumor region in MRI images. For comparison analysis, our proposed approach is compared with the existing works using K‐cross fold validation method. From the results, we can conclude that the modified multi‐texton histogram with non‐linear kernels has shown the accuracy of 86% but the MTH with non‐linear kernels shows the accuracy of 83.8%.