Abstract:We describe techniques for combining two types of knowledge systems: expert and machine learning. Both the expert system and the learning system represent information by logical decision rules or trees. Unlike the classical views of knowledge-base evaluation or refinement, our view accepts the contents of the knowledge base as completely correct. The knowledge base and the results of its stored cases will provide direction for the discovery of new relationships in the form of newly induced decision rules. An e… Show more
“…This finding corroborates with conclusions drawn by [30,33,9]. However, the methodologies put forward by these authors typically require very timeconsuming and demanding information-extraction tasks from the experts.…”
Section: Discussionsupporting
confidence: 89%
“…Weiss et al [30] build a DMS using only expert knowledge as input data to predict promising sales leads. Sinha and Zhao [9] combine expert knowledge with a DMS in the context of credit ratings.…”
Section: Human Expert Systems Data-mining Systems and Information Fumentioning
confidence: 99%
“…First, our method does not only rely on expert opinions in the DSS (e.g., [30]). Moreover it overcomes the drawbacks of Sinha and Zhao [9]'s approach in which domain experts have to evaluate every unit of analysis.…”
Section: Human Expert Systems Data-mining Systems and Information Fumentioning
Interest in the use of (big) company data and data-mining models to guide decisions exploded in recent years. In many domains there are human experts whose knowledge is essential in building, interpreting and applying these models. However, the impact of integrating expert opinions into the decision-making process has not been sufficiently investigated. This research gap deserves attention because the triangulation of information sources is critical for the success of analytical projects. This paper contributes to the decision-making literature by (a) detailing the natural advantages of the Bayesian framework for fusing multiple information sources into one decision support system (DSS), (b) confirming the necessity for adjusted methods in this data-explosion era, and (c) opening the path to future applications of Bayesian DSSs in other organizational research contexts. In concrete, we propose a Bayesian decision support framework that formally fuses subjective human expert opinions with more objective organizational information. We empirically test the proposed Bayesian fusion approach in the context of a customer-satisfaction prediction study and show how it improves the prediction performance of the human experts and a data-mining model ignoring expert information.
“…This finding corroborates with conclusions drawn by [30,33,9]. However, the methodologies put forward by these authors typically require very timeconsuming and demanding information-extraction tasks from the experts.…”
Section: Discussionsupporting
confidence: 89%
“…Weiss et al [30] build a DMS using only expert knowledge as input data to predict promising sales leads. Sinha and Zhao [9] combine expert knowledge with a DMS in the context of credit ratings.…”
Section: Human Expert Systems Data-mining Systems and Information Fumentioning
confidence: 99%
“…First, our method does not only rely on expert opinions in the DSS (e.g., [30]). Moreover it overcomes the drawbacks of Sinha and Zhao [9]'s approach in which domain experts have to evaluate every unit of analysis.…”
Section: Human Expert Systems Data-mining Systems and Information Fumentioning
Interest in the use of (big) company data and data-mining models to guide decisions exploded in recent years. In many domains there are human experts whose knowledge is essential in building, interpreting and applying these models. However, the impact of integrating expert opinions into the decision-making process has not been sufficiently investigated. This research gap deserves attention because the triangulation of information sources is critical for the success of analytical projects. This paper contributes to the decision-making literature by (a) detailing the natural advantages of the Bayesian framework for fusing multiple information sources into one decision support system (DSS), (b) confirming the necessity for adjusted methods in this data-explosion era, and (c) opening the path to future applications of Bayesian DSSs in other organizational research contexts. In concrete, we propose a Bayesian decision support framework that formally fuses subjective human expert opinions with more objective organizational information. We empirically test the proposed Bayesian fusion approach in the context of a customer-satisfaction prediction study and show how it improves the prediction performance of the human experts and a data-mining model ignoring expert information.
“…The key point is that these two approaches, knowledge elicitation from experts and knowledge discovery from data, complement each other (da Silva, Amorim, Campos, & Brasil, 2002;Daniels & van Dissel, 2002;de la Vega et al, 2010;Weiss, Buckley, Kapoor, & Damgaard, 2003). Applied together, they can be used to build better systems: data mining techniques can be used to support the different tasks involved in expert system (ES) or knowledge-based system (KBS) development (Flior et al, 2010;Mejia-Lavalle & Rodriguez-Ortiz, 1998;Phuong, Phong, Santiprabhob, & Baets, 2001;Wang, Liu, & Cheng, 2004), and expert knowledge can be used to facilitate and improve the results of the different stages of the KDD process (Kusiak & Shah, 2006;Zhang & Figueiredo, 2006).…”
Expert systems are built from knowledge traditionally elicited from the human expert. It is precisely knowledge elicitation from the expert that is the bottleneck in expert system construction. On the other hand, a data mining system, which automatically extracts knowledge, needs expert guidance on the successive decisions to be made in each of the system phases. In this context, expert knowledge and data mining discovered knowledge can cooperate, maximizing their individual capabilities: data mining discovered knowledge can be used as a complementary source of knowledge for the expert system, whereas expert knowledge can be used to guide the data mining process. This article summarizes different examples of systems where there is cooperation between expert knowledge and data mining discovered knowledge and reports our experience of such cooperation gathered from a medical diagnosis project called Intelligent Interpretation of Isokinetics Data, which we developed. From that experience, a series of lessons were learned throughout project development. Some of these lessons are generally applicable and others pertain exclusively to certain project types.
“…Work in meta-learning is also quite relevant as it attempts to support DM: see METAL (www.metal-kdd.org), [6], and [24]. Other recent work in the field of KDD (Knowledge Discovery in Databases) is that of [13] in which an ontology is used to model domain knowledge to support the KDD process, that of [20] where an environment for the rapid development of pre-DM processing chains is introduced, and that of [25] in which expert system and machine learning technologies are combined to support DM. Work dealing with conceptual queries and online/Web (interactive) DM is also of interest since it must take into account some elements of the DS dimension: see [9], for instance.…”
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.