Expert Judgment Z-Numbers as a Ranking Indicator for Hierarchical Fuzzy Logic System

Abstract

<p>In this article, the researchers main contribution is to investigate three factors which may correlate in implementation of Expert Judgment Z-Numbers as new Fuzzy Logic Ranking Indicator such as: expert relevance judgment or score, the expert confidence and the level of expertise. The Expert Judgment Z-Numbers then will be an input to the Hierarchical Fuzzy Logic System of Domain Specific Text Retrieval, along with other indicators such as Ontology BM25 Score, Fabrication Rate, Shia Rate and Positive Rate of hadith document. The results showed, the proposed system, with the additional new indicator of Expert Judgment Z-Numbers, may improve the original BM25 ranking function, by yielding better results on 26 queries, on all evaluation metrics that are measured in this research such as P@10, %no measures and MAP, and has achieved better results in 28 queries on P@10 alone, compared to the BM25 original score, that only yield better results in 2 queries on all evaluation metrics, and also yield better results in 4 queries on the MAP alone. The results proved that the proposed system has a capability to utilize the expert confidence and their relevant judgment that are represented in Z-Number, as an indicator to optimize the existing ranking function system and has a potential for a further research to be conducted on these domains. For the future works, the researchers would like to enhance this research by including a variety of expert’s level confidence and their judgment, also a new calculation to represent the value of Z-Numbers.</p>

Automatic dependent bug reports assembly for bug tracking systems by threshold-based similarity

“…2.4.3. BM25 approach for text similarity BM25 is a well-known ranking function that ranks matching relevant documents according to their relevance to a given search query ( ), regardless of the inter-relationship between the query terms within a document [56], [57]. It notices that 'query' in this study referred to meta-bug report.…”