Weakly Supervised Medication Regimen Extraction from Medical Conversations

Patel, Dhruvesh; Konam, Sandeep; Prabhakar, Sai

doi:10.18653/v1/2020.clinicalnlp-1.20

Cited by 8 publications

(12 citation statements)

References 25 publications

(27 reference statements)

Supporting

Mentioning

Contrasting

Order By: Relevance

“…After screening the titles and abstracts of these articles, we assessed 144 full-text articles for eligibility. We included 20 articles [19][20][21][22][23][24][25][26][27][28][29][30][31][32][33][34][35][36][37][38] for our analysis (Fig. 1 and Supplementary Table 2).…”

Section: Study Selectionmentioning

confidence: 99%

“…1 and Supplementary Table 2). Of these, ten were conference proceedings [19][20][21]23,27,28,32,38 , seven were workshop proceedings 22,26,29,[34][35][36][37] , two were journal articles 24,25 , and three were Arxiv preprints 30,31,33 .…”

Section: Study Selectionmentioning

confidence: 99%

“…Three studies focused on improving the ASR for clinical conversations as the first step towards accurately extracting information from them 19,21,36 . Eleven studies chose to manually transcribe the conversations and performed NLP tasks on the transcripts 20,22,24,25,27,[30][31][32]34,35,40 . Five studies used input data representative of the input of an implemented digital scribe (ASR transcripts or chat dialogs) 26,28,33,37,38 .…”

Section: Setting and Research Phasementioning

confidence: 99%

See 2 more Smart Citations

The digital scribe in clinical practice: a scoping review and research agenda

et al. 2021

View full text Add to dashboard Cite

The number of clinician burnouts is increasing and has been linked to a high administrative burden. Automatic speech recognition (ASR) and natural language processing (NLP) techniques may address this issue by creating the possibility of automating clinical documentation with a “digital scribe”. We reviewed the current status of the digital scribe in development towards clinical practice and present a scope for future research. We performed a literature search of four scientific databases (Medline, Web of Science, ACL, and Arxiv) and requested several companies that offer digital scribes to provide performance data. We included articles that described the use of models on clinical conversational data, either automatically or manually transcribed, to automate clinical documentation. Of 20 included articles, three described ASR models for clinical conversations. The other 17 articles presented models for entity extraction, classification, or summarization of clinical conversations. Two studies examined the system’s clinical validity and usability, while the other 18 studies only assessed their model’s technical validity on the specific NLP task. One company provided performance data. The most promising models use context-sensitive word embeddings in combination with attention-based neural networks. However, the studies on digital scribes only focus on technical validity, while companies offering digital scribes do not publish information on any of the research phases. Future research should focus on more extensive reporting, iteratively studying technical validity and clinical validity and usability, and investigating the clinical utility of digital scribes.

show abstract

Section: Study Selectionmentioning

confidence: 99%

Section: Study Selectionmentioning

confidence: 99%

Section: Setting and Research Phasementioning

confidence: 99%

See 1 more Smart Citation

The digital scribe in clinical practice: a scoping review and research agenda

et al. 2021

View full text Add to dashboard Cite

show abstract

“…Furthermore, recently, there has been additional work on the analysis of medical conversation. [57][58][59][60][61] However, the corresponding models and methodologies for these studies are not publicly available for evaluation and comparison in this project.…”

Section: Background and Significancementioning

confidence: 99%

Natural Language Processing for Automated Annotation of Medication Mentions in Primary Care Visit Conversations

Ganoe

Barr

et al. 2021

Preprint

View full text Add to dashboard Cite

Objectives: The objective of this study is to build and evaluate a natural language processing approach to identify medication mentions in primary care visit conversations between patients and physicians. Materials and Methods: Eight clinicians contributed to a dataset of 85 clinic visit transcripts, and ten transcripts were randomly selected from this dataset as a development set. Our approach utilizes Apache cTAKES and Unified Medical Language System (UMLS) controlled vocabulary to generate a list of medication candidates in the transcribed text, and then performs multiple customized filters to exclude common false positives from this list while including some additional common mentions of the supplements and immunizations. Results: Sixty-five transcripts with 1,121 medication mentions were randomly selected as an evaluation set. Our proposed method achieved an F-score of 85.0% for identifying the medication mentions in the test set, significantly outperforming existing medication information extraction systems for medical records with F-scores ranging from 42.9% to 68.9%. Discussion: Our medication information extraction approach for primary care visit conversations showed promising results, extracting about 27% more medication mentions from our evaluation set while eliminating many false positives in comparison to existing baseline systems. We made our approach publicly available on the web as an open-source software. Conclusion: Integration of our annotation system with clinical recording applications has the potential to improve patients' understanding and recall of key information from their clinic visits, and, in turn, to positively impact health outcomes.

show abstract

“…Du et al (2019a,b) proposed several methods for extracting entities such as symptoms and medications and their relations. Selvaraj and Konam (2019) and Patel et al (2020) examined the task of medication regimen extraction. While recent research in medical conversations is primarily focused on extracting symptoms and medications, we propose a new task of extracting appointment spans.…”

Section: Related Workmentioning

confidence: 99%

Extracting Appointment Spans from Medical Conversations

Meripo¹,

Konam²

2021

Proceedings of the Second Workshop on Natural Language Processing for Medical Conversations

Self Cite

View full text Add to dashboard Cite

Extracting structured information from medical conversations can reduce the documentation burden for doctors and help patients follow through with their care plan. In this paper, we introduce a novel task of extracting appointment spans from medical conversations. We frame this task as a sequence tagging problem and focus on extracting spans for appointment reason and time. However, annotating medical conversations is expensive, time-consuming, and requires considerable domain expertise. Hence, we propose to leverage weak supervision approaches, namely incomplete supervision, inaccurate supervision, and a hybrid supervision approach and evaluate both generic and domain-specific, ELMo, and BERT embeddings using sequence tagging models. The best performing model is the domain-specific BERT variant using weak hybrid supervision and obtains an F1 score of 79.32.

show abstract

Weakly Supervised Medication Regimen Extraction from Medical Conversations

Cited by 8 publications

References 25 publications

The digital scribe in clinical practice: a scoping review and research agenda

The digital scribe in clinical practice: a scoping review and research agenda

Natural Language Processing for Automated Annotation of Medication Mentions in Primary Care Visit Conversations

Extracting Appointment Spans from Medical Conversations

Contact Info

Product

Resources

About