Monitoring and evaluation of on-line information system usage

Penniman, W. David; Dominick, Wayne D.

doi:10.1016/0306-4573(80)90003-5

Cited by 38 publications

(12 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Online monitoring, also known as transaction log analysis, is a proven technique for evaluating searching behavior and complements other methods such as interviews and visual observations (Borgman, Hirsh, & Hiller, 1996). It also is considered to be a powerful and flexible technique for data collection to analyze user interactions with an IR system and to evaluate IR interfaces (Penniman & Dominick, 1980). Within this study, Lotus ScreenCam, a commercial screen-capturing software package produced by IBM Software Group, was utilized.…”

Section: Data-gathering Toolsmentioning

confidence: 99%

Query expansion behavior within a thesaurus‐enhanced search environment: A user‐centered evaluation

Shiri

Revie

2006

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

The study reported here investigated the query expansion behavior of end-users interacting with a thesaurusenhanced search system on the Web. Two groups, namely academic staff and postgraduate students, were recruited into this study. Data were collected from 90 searches performed by 30 users using the OVID interface to the CAB abstracts database. Data-gathering techniques included questionnaires, screen capturing software, and interviews. The results presented here relate to issues of search-topic and search-term characteristics, number and types of expanded queries, usefulness of thesaurus terms, and behavioral differences between academic staff and postgraduate students in their interaction. The key conclusions drawn were that (a) academic staff chose more narrow and synonymous terms than did postgraduate students, who generally selected broader and related terms; (b) topic complexity affected users' interaction with the thesaurus in that complex topics required more query expansion and search term selection; (c) users' prior topic-search experience appeared to have a significant effect on their selection and evaluation of thesaurus terms; (d) in 50% of the searches where additional terms were suggested from the thesaurus, users stated that they had not been aware of the terms at the beginning of the search; this observation was particularly noticeable in the case of postgraduate students.

show abstract

Section: Data-gathering Toolsmentioning

confidence: 99%

Query expansion behavior within a thesaurus‐enhanced search environment: A user‐centered evaluation

Shiri

Revie

2006

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

show abstract

“…To ensure user privacy, identifiable user codes were recoded to produce consistent but anonymous individual user codes (Penniman & Dominick, 1980). A key concept embodied within the transaction monitoring technique is that of an information-searching session (He & Göker, 2000), that is, a demarcating of the collection of transaction records so that together they constitute (for a particular user) a self-contained episode of information searching (Borgman, Hirsh, & Hiller, 1996;Peters, 1993).…”

Section: Data Collectionmentioning

confidence: 99%

A longitudinal study of World Wide Web users' information‐searching behavior

Cothey

2001

J. Am. Soc. Inf. Sci.

View full text Add to dashboard Cite

A study of the "real world" Web information searching behavior of 206 college students over a 10-month period showed that, contrary to expectations, the users adopted a more passive or browsing approach to Web information searching and became more eclectic in their selection of Web hosts as they gained experience. The study used a longitudinal transaction log analysis of the URLs accessed during 5,431 user days of Web information searching to detect changes in information searching behavior associated with increased experience of using the Web. The findings have implications for the design of future Web information retrieval tools.

show abstract

“…Moreover, strategies are inherently temporal and variable in length, making coding and analysis difficult. Although analysis of user states and transitions has been used to assess tactics and determine strategies [20,25], new methods of analyzing such data are needed. In the meantime, it seems prudent to apply the incomparable pattern recognition capabilities of the human mind directly to the process of learning in order to make direct inferences about learning patterns.…”

Section: 9mentioning

confidence: 99%

Evaluating Hypermedia-Based Learning

Marchionini

1990

Designing Hypermedia for Learning

View full text Add to dashboard Cite

Monitoring and evaluation of on-line information system usage

Cited by 38 publications

References 10 publications

Query expansion behavior within a thesaurus‐enhanced search environment: A user‐centered evaluation

Query expansion behavior within a thesaurus‐enhanced search environment: A user‐centered evaluation

A longitudinal study of World Wide Web users' information‐searching behavior

Evaluating Hypermedia-Based Learning

Contact Info

Product

Resources

About