This study compares searches in two different keyword indexes with similar content. Search results are dependent on the quality of the search strategy, the search engine execution, and the content the search is run against. This study examines the degree to which changing the search engine execution with only slight changes in index content would have on search results. The results indicate that search engine execution has a dramatic impact on the number of matches for most searches. Analysis also reveals that user search strategy did not change even though the way the search engine executes the search changed dramatically and new features and commands that they could use to refine their searches were added. Users appear to be ignoring search help screens and continue to do basic searches that negatively affect the number of relevant matches. Providing more features for constructing better searches will not necessarily result in better search strategy.I n this age of information overload the ability to extract information from large databases has never been more important. Search engines have undergone considerable change since the early days when Boolean searching was considered revolutionary. Nevertheless the perfect search engine still eludes librarians. This is partially because of the relative nature of the search process. Search results are relative to the user's search strategy, the fields that are indexed, and the way the search is executed by the search engine. Librarians have known for many years that search algorithms have a dramatic effect on search results. Likewise, many debates have been centered on the question of what content is best to index. However, little research has been conducted on the question of how search engine execution influences results, or the combined effects of the three conditions. In the fall of 2000, librarians at the University of NebraskaLincoln had the unique opportunity to study two different keyword indexes that execute searches very differently.Prior to December 2000, the University of Nebraska-Lincoln Libraries (UNL) used the Word Index purchased when the Innovative Interfaces Inc. (III) system was installed in 1990. This search engine executes a search using a set of "rules" to govern the search
146Index Relativity and Patron Search Strategy process. All punctuation marks and diacritics are ignored and spaces between words are treated as a Boolean "AND." For example, "short stories" searches as "short AND stories," not the phrase "short stories." Apostrophes are removed; for example "clarissa's" is searched as "clarissas." The index also ignores common words such as "a", "an", "the", and single letters. Items in parentheses are evaluated first, with multiple parentheses being evaluated in a left to right progression. Boolean operators are not treated as equals by the search engine, which searches "ANDs" before "NOTs" and then "NOTs" before "ORs."For example, the search Merlin or Arthur and Henry V would search as: Arthur AND Henry OR Merlin The search engin...