DSR: A Collection for the Evaluation of Graded Disease-Symptom Relations

Abstract

The effective extraction of ranked disease-symptom relationships is a critical component in various medical tasks, including computerassisted medical diagnosis or the discovery of unexpected associations between diseases. While existing disease-symptom relationship extraction methods are used as the foundation in the various medical tasks, no collection is available to systematically evaluate the performance of such methods. In this paper, we introduce the Disease-Symptom Relation Collection (dsr-collection), created by five physicians as expert annotators. We provide graded symptom judgments for diseases by differentiating between relevant symptoms and primary symptoms. Further, we provide several strong baselines, based on the methods used in previous studies. The first method is based on word embeddings, and the second on co-occurrences of MeSH-keywords of medical articles. For the cooccurrence method, we propose an adaption in which not only keywords are considered, but also the full text of medical articles. The evaluation on the dsr-collection shows the effectiveness of the proposed adaption in terms of nDCG, precision, and recall.

Biyomedikal literatürden solunum yolu hastalıkları ve semptom ilişkilerinin çıkarılması için semantik benzerlik temelli bir yaklaşım

“…Tarafından sıralama yöntemlerinin performansını değerlendirmek için bir hastalık semptom koleksiyonu oluşturulmuştur. Hastalıklar ve semptomlar arasındaki ilişki, birlikte görülme istatistikleri kullanılarak belirlenerek, koleksiyon ile değerlendirilmiştir [36]. Wada vd.…”