A machine learning approach to inductive query by examples: An experiment using relevance feedback, ID3, genetic algorithms, and simulated annealing

Abstract

Information retrieval using probabilistic techniques has attracted significant attention on the part of researchers in information and computer science over the past few decades. In the 1980s, knowledge‐based techniques also made an impressive contribution to “intelligent” information retrieval and indexing. More recently, information science researchers have turned to other newer inductive learning techniques including symbolic learning, genetic algorithms, and simulated annealing. These newer techniques, which are grounded in diverse paradigms, have provided great opportunities for researchers to enhance the information processing and retrieval capabilities of current information systems. In this article, we first provide an overview of these newer techniques and their use in information retrieval research. In order to familiarize readers with the techniques, we present three promising methods: The symbolic ID3 algorithm, evolution‐based genetic algorithms, and simulated annealing. We discuss their knowledge representations and algorithms in the unique context of information retrieval. An experiment using a 8000‐record COMPEN database was performed to examine the performances of these inductive query‐by‐example techniques in comparison with the performance of the conventional relevance feedback method. The machine learning techniques were shown to be able to help identify new documents which are similar to documents initially suggested by users, and documents which contain similar concepts to each other. Genetic algorithms, in particular, were found to out‐perform relevance feedback in both document recall and precision. We believe these inductive machine learning techniques hold promise for the ability to analyze users' preferred documents (or records), identify users' underlying information needs, and also suggest alternatives for search for database management systems and Internet applications. © 1998 John Wiley & Sons, Inc.

Machine learning for query formulation in question answering

“…Chen et al . (1998) did apply machine learning techniques for selecting query terms, but it was done in the context of relevance feedback retrieval. More recently, Bendersky and Croft (2008) developed an approach to identify the most important concepts in verbose ad hoc retrieval queries.…”

Semantic Content Filtering with Wikipedia and Ontologies

“…The builder mapping B is implemented by using the genetic programming (GP) technique proposed by Malo et al [20] that extends the Inductive Query By Example (IQBE) paradigm of Smith and Smith [21] and Chen et al [22]. There, the idea is to use the relevance information collected from the user as fitness cases to find the query expression that best separates relevant from irrelevant document examples.…”

Assisting the searcher: utilizing software agents for Web search systems

“…Although simple in this implementation, we believe that the optimization approach prevents the search from narrowing too rapidly. Naturally, evaluations would need to be done on the appropriate optimization algorithm to most effectively select terms, although Chen et al (1998) have shown the three most well known optimization algorithms all perform equally well.…”