A benchmark dataset and case study for Chinese medical question intent classification

Abstract

Background: To provide satisfying answers, medical QA system has to understand the intentions of the users' questions precisely. For medical intent classification, it requires high-quality datasets to train a deep-learning approach in a supervised way. Currently, there is no public dataset for Chinese medical intent classification, and the datasets of other fields are not applicable to the medical QA system. To solve this problem, we construct a Chinese medical intent dataset (CMID) using the questions from medical QA websites. On this basis, we compare four intent classification models on CMID using a case study. Methods: The questions in CMID are obtained from several medical QA websites. The intent annotation standard is developed by the medical experts, which includes four types and 36 subtypes of users' intents. Besides the intent label, CMID also provides two types of additional information, including word segmentation and named entity. We use the crowdsourcing way to annotate the intent information for each Chinese medical question. Word segmentation and named entities are obtained using the Jieba and a well-trained Lattice-LSTM model. We loaded a Chinese medical dictionary consisting of 530,000 for word segmentation to obtain a more accurate result. We also select four popular deep learning-based models and compare their performances of intent classification on CMID. Results: The final CMID contains 12,000 Chinese medical questions and is organized in JSON format. Each question is labeled the intention, word segmentation, and named entity information. The information about question length, number of entities, and are also detailed analyzed. Among Fast Text, TextCNN, TextRNN, and TextGCN, Fast Text and TextCNN models have achieved the best results in four types and 36 subtypes intent classification, respectively. Conclusions: In this work, we provide a dataset for Chinese medical intent classification, which can be used in medical QA and related fields. We performed an intent classification task on the CMID. In addition, we also did some analysis on the content of the dataset.

A Comparative Study of Natural Language Processing Algorithms Based on Cities Changing Diabetes Vulnerability Data

“…Convolutional Neural Network (CNN) [ 17 ] achieved the best performance in Chinese medical question intent classification because of the powerful short text feature extraction capability [ 18 ]. CNN outperformed the support vector machine (SVM) in a topic classification task for the breast cancer online community [ 19 ].…”

Incremental Intent Detection for Medical Domain with Contrast Replay Networks

“…The goal of intent detection is to identify query intent and classify them into specific categories (Chen et al, 2012;Howard and Cambria, 2013;Guo et al, 2014;Cai et al, 2017). With artificial intelligence gradually changing the landscape of healthcare and biomedical research (Yu et al, 2018), medical intent detection (Zhang et al, 2021;Chen et al, 2020a) becomes an important task. In medical domain, query intent can be divided into many categories, such as disease description, medical fees, treatment plan, precautions, and so on, which are domain-specific with highly specialized medical knowledge (Zhang et al, 2021).…”

“…We use two public medical datasets KUAKE-QIC in CBLUE (Zhang et al, 2021) and CMID (Chen et al, 2020a) to construct benchmarks for incremental learning setting. For a medical intent detection dataset, its intent classes are arranged in a fixed order.…”

Chinese short text classification by combining Bert and graph convolutional network

“…As show in Table 1, the two datasets are all from the open source datasets in the network. The CMID 12 dataset divides the training data and the test data by 3:1. The amount of data in CHIP_CTC 13 is divided by the provider.…”