Written versus spoken queries: A qualitative and quantitative comparative analysis

Crestani, Fábio; Du, Heather

doi:10.1002/asi.20350

Cited by 40 publications

(36 citation statements)

References 17 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The initial formulation of a query strongly affects search results, and thus affects experimental results. Crestani and Du (2006) found that using speech to formulate one's information need provides a way to express it more naturally than for written topics. We believe that using spoken topics prevents users from copying keywords directly from given topics to formulate their queries.…”

Section: Search Topicsmentioning

confidence: 98%

LibraryFind: System design and usability testing of academic metasearch system

Jung

Herlocker

Webster

et al. 2007

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

Using off-the-shelf search technology provides a single point of access into library resources, but we found that such commercial systems are not entirely satisfactory for the academic library setting. In response to this, Oregon State University (OSU) Libraries designed and deployed LibraryFind, a metasearch system. We conducted a usability experiment comparing LibraryFind, the OSU Libraries Web site, and Google Scholar. Each participant used all three search systems in a controlled setting, and we recorded their behavior to determine the effectiveness and efficiency of each search system. In this article, we focus on understanding what factors are important to undergraduates in choosing their primary academic search system for class assignments. Based on a qualitative and quantitative analysis of the results, we found that mimicking commercial Web search engines is an important factor to attract undergraduates; however, when undergraduates use these kinds of search engines, they expect similar performance to Web search engines, including factors such as relevance, speed, and the availability of a spell checker. They also expected to be able to find out what kinds of content and materials are available in a system. Participants' prior experience using academic search systems also affected their expectations of a new system. IntroductionToday's academic library Web sites serve as gateways to digitally accessible library resources, ranging from full-text newspaper and journal articles to online catalogs of physical collections. Yet, undergraduate students often use Web-based search engines as primary tools to find class-related information not only because they are familiar with Web-based search engines (Augustine & Greene, 2002;Notovny, 2004) but also because they struggle to use library Web sites as a gateway for finding information (Chisman, Diller, & Walbridge, 1999; Eliason, McKinstry, & Fraser, 1997;Notovny, 2004;Stephan, Cheng, & Young, 2006;Yakel, 2004).Many researchers in library and information science focus on improving library Web sites so that navigating library services is easy. These include local resources (e.g., the library catalog) as well as databases offered by third-party vendors (e.g., Academic Search Premier). Yet, navigation remains difficult for novice users unfamiliar with exploiting the multiplicity of library services: They do not know where to start in part because they do not know which databases are appropriate for their current information need (Eliason et al., 1997;Stephan et al., 2006). Novice users also find it difficult to identify useful documents from the returned results (Eliason et al., 1997;Stephan et al., 2006). Undergraduates expect disparate library resources to be aggregated so that a single query will return satisfactory results (Augustine & Greene, 2002;Notovny, 2004).One promising approach to these persistent issues is simplifying the search rather than constantly revising the library Web site to improve navigation. For that reason, researchers are experimenting wi...

show abstract

Section: Search Topicsmentioning

confidence: 98%

LibraryFind: System design and usability testing of academic metasearch system

Jung

Herlocker

Webster

et al. 2007

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…[163] Example 3: What are the differences between written and spoken queries in terms of their retrieval characteristics and performance outcomes? [62] Example 4: What is the relationship between query box size and query length? What is the relationship between query length and performance?…”

Section: Problems and Questionsmentioning

confidence: 99%

Methods for Evaluating Interactive Information Retrieval Systems with Users

Kelly

2007

FNT in Information Retrieval

394

308

View full text Add to dashboard Cite

“…Schalkwyk et al [19] reported statistics of queries from Google Voice's search logs which found that voice queries are statistically shorter than desktop search queries. Crestani et al [6] conducted a user experiment based on collections of users' voice queries. However, the experiment environment did not involve a real search system.…”

Section: Related Work 21 Voice Searchmentioning

confidence: 99%

“…During voice search, users can vocalize their queries and the retrieval system utilizes the voice recognition results for retrieval [6,19]. Though previous studies found that query reformulation plays an important role in conventional textual search systems, to the best of our knowledge, there are very limited studies on voice search, especially concerning users' query reformulation in voice search.…”

Section: Introductionmentioning

confidence: 99%

How do users respond to voice input errors?

Jiang

Jeng

2013

Proceedings of the 36th International ACM SIGIR Conference on Research and Development in Information Retrieval

View full text Add to dashboard Cite

Voice search offers users with a new search experience: instead of typing, users can vocalize their search queries. However, due to voice input errors (such as speech recognition errors and improper system interruptions), users need to frequently reformulate queries to handle the incorrectly recognized queries. We conducted user experiments with native English speakers on their query reformulation behaviors in voice search and found that users often reformulate queries with both lexical and phonetic changes to previous queries. In this paper, we first characterize and analyze typical voice input errors in voice search and users' corresponding reformulation strategies. Then, we evaluate the impacts of typical voice input errors on users' search progress and the effectiveness of different reformulation strategies on handling these errors. This study provides a clearer picture on how to further improve current voice search systems.

show abstract

Written versus spoken queries: A qualitative and quantitative comparative analysis

Cited by 40 publications

References 17 publications

LibraryFind: System design and usability testing of academic metasearch system

LibraryFind: System design and usability testing of academic metasearch system

Methods for Evaluating Interactive Information Retrieval Systems with Users

How do users respond to voice input errors?

Contact Info

Product

Resources

About