Different Data Mining Approaches Based Medical Text Data

Abstract

The amount of medical text data is increasing dramatically. Medical text data record the progress of medicine and imply a large amount of medical knowledge. As a natural language, they are characterized by semistructured, high-dimensional, high data volume semantics and cannot participate in arithmetic operations. Therefore, how to extract useful knowledge or information from the total available data is very important task. Using various techniques of data mining can extract valuable knowledge or information from data. In the current study, we reviewed different approaches to apply for medical text data mining. The advantages and shortcomings for each technique compared to different processes of medical text data were analyzed. We also explored the applications of algorithms for providing insights to the users and enabling them to use the resources for the specific challenges in medical text data. Further, the main challenges in medical text data mining were discussed. Findings of this paper are benefit for helping the researchers to choose the reasonable techniques for mining medical text data and presenting the main challenges to them in medical text data mining.

Mapping potential malaria vector larval habitats for larval source management: Introduction to multi-model ensembling approaches

“…Prediction accuracy of the final model was assessed using the testing data set, and the model was calibrated using the validation data set. Since we had binary outcomes, we also calculated the sensitivity, specificity, area under curve (AUC), positive/negative likelihood ratios and positive/negative predictive values for each model [37,59,60]. Agreement between observed and predicted records was measured using the Kappa statistic [61,62].…”

“…Variable selection for other models was based on either a significance test (P < 0.05) or relative importance score (<1%) [29]. In addition to using a separate data set for validation, to further reduce predictive bias and uncertainty (i.e., variance of performance estimates) we used 10-fold cross-validation (10-fold cv) for the training of all models except NNW, since we had a large training data set [29,53,58,59]. For aquatic habitat identification, we used both field-observed aquatic habitats (yes) and pseudo-habitats (no).…”

Big Data Bot with a Special Reference to Bioinformatics

“…International Data Corporation stated that unstructured data would make up 95% of all data worldwide in 2020, with a compound annual growth rate of 65% [30]. Due to the quality and usability concerns with large unstructured datasets, structured data are more relevant and valuable than unstructured or semi-structured data [31].…”

“…Analyzing this huge amount of medical data to extract meaningful knowledge or information is useful in the medical field for decision support, prevention, diagnosis, and treatment. However, processing vast amounts of multidimensional or raw data is a difficult and time-consuming operation [30] but is absolutely necessary for the advancement of science in general. This challenge has led to new standards for using data so that data are Findable, Accessible, Interoperable, and Reusable (FAIR) [38].…”

Predicting three-month fasting blood glucose and glycated hemoglobin of patients with type 2 diabetes based on multiple machine learning algorithms

“…With the continuous development of database and data mining technology, data mining is more and more used to mine medical databases e ciently [7] . The existing data mining technology application research shows that the model established by data mining has high accuracy [8] .…”