Investigating the human-computer interface using the Datalogger

Westerman, S. J.; Hambly, S.; Alder, Christopher; Wyatt-Millington, C. W.; Shryane, Nick; Crawshaw, C. M.; Hockey, G. R. J.

doi:10.3758/bf03200549

Cited by 9 publications

(10 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Timing records can be useful for comparing different software applications and are also necessary for building and testing user models. Westerman et al (1996) described three different methods through which user information can be obtained. The first method, using videotape or a human recorder, is not always feasible.…”

mentioning

confidence: 99%

“…Several such tools currently exist, but there are few that record both mouse and key events and even fewer that give logs in a form that would be useful to researchers and practitioners of human-computer interaction. Several of these recording and playback tools can be downloaded from the Web, but typically these were developed as malicious "spyware" to provide keystroke logs without timing information.A tool similar to RUI was developed (Westerman et al, 1996) for the Windows 3.1 platform, but it appears no longer to be available. MICELAB (Baccino & Kennedy, 1995) is another similar tool, but it does not run on modern computers, although Baccino and Kennedy's analysis approach is still helpful in analyzing mouse movements.…”

mentioning

confidence: 99%

“…A tool similar to RUI was developed (Westerman et al, 1996) for the Windows 3.1 platform, but it appears no longer to be available. MICELAB (Baccino & Kennedy, 1995) is another similar tool, but it does not run on modern computers, although Baccino and Kennedy's analysis approach is still helpful in analyzing mouse movements.…”

mentioning

confidence: 99%

See 2 more Smart Citations

RUI: Recording user input from interfaces under Windows and Mac OS X

Kukreja

Stevenson

Ritter

2006

Behavior Research Methods

View full text Add to dashboard Cite

Timing records of the way users interact with applications can lead to useful insights into human behavior and an application's usability. Timing records can be useful for comparing different software applications and are also necessary for building and testing user models.Westerman et al. (1996) described three different methods through which user information can be obtained. The first method, using videotape or a human recorder, is not always feasible. The video recording must be analyzed, and the human recorder has known limitations. Camtasia (TechSmith) is an example of a tool to record and replay user interactions as a video file. However, timing information cannot be directly obtained, and the tool creates logs that, being videos, are resource intensive.The second method, instrumentation, is the augmentation of an interface so that it records the user's actions. This approach can be used only if the system studied includes logging or can be modified to include logging, so it is not a general solution; information collected in this way is limited to software that can be instrumented. For example, some commercial applications, such as Microsoft Word and many games, cannot be instrumented to record user behavior.The third method is to include an unobtrusive application that exists in the background, can be used generically across all applications, and can record and timestamp user behavior. In this article, we introduce such a program: Recording User Input (RUI), which belongs to the set of programs known as keystroke logging tools. Several such tools currently exist, but there are few that record both mouse and key events and even fewer that give logs in a form that would be useful to researchers and practitioners of human-computer interaction. Several of these recording and playback tools can be downloaded from the Web, but typically these were developed as malicious "spyware" to provide keystroke logs without timing information.A tool similar to RUI was developed (Westerman et al., 1996) for the Windows 3.1 platform, but it appears no longer to be available. MICELAB (Baccino & Kennedy, 1995) is another similar tool, but it does not run on modern computers, although Baccino and Kennedy's analysis approach is still helpful in analyzing mouse movements. Another tool, InputLogger, can be used to obtain user interactions across generic interfaces, but it works only on the Classic Macintosh (pre-Mac OS X) platform (Trewin, 1998). Several large commercial products are also available. Description of RUIRUI is a keystroke and mouse action logger for the Windows (2000 and XP) and Mac OS X (10.3 and later versions) platforms. RUI's user interface includes options for which types of actions to record, including keystrokes and mouse movements. The data collected is stored in a log file (see Figure 1) as a list of the timestamps, actions, and arguments (if any), such as key pressed or move location. To start and stop recording, the hot keys Ctrl R and Ctrl S, respectively, are provided. The amount of data recorded with...

show abstract

mentioning

confidence: 99%

mentioning

confidence: 99%

See 1 more Smart Citation

RUI: Recording user input from interfaces under Windows and Mac OS X

Kukreja

Stevenson

Ritter

2006

Behavior Research Methods

View full text Add to dashboard Cite

show abstract

“…This kind of 'background' recording software has an established history of use in HCI research (Westerman et al, 1996). The programs can be run with-these dayslittle impact on a computer's performance.…”

Section: Discussionmentioning

confidence: 99%

Technology‐enhanced research: educational ICT systems as research instruments

Cox

2007

Technology, Pedagogy and Education

View full text Add to dashboard Cite

Determining the potential of educational information and communications technology for enhancing teaching and learning is the subject of a great deal of research activity. This paper argues that the technologies employed to enhance learning can also be exploited for the enhancement of research. Recorded learner-system interactions, dynamically captured computer screen activity and visual attention tracking all provide sources of rich process data that can be triangulated with tradition learning outcome (product) data. Such multiple data source approaches can be used in various research design and methodological contexts-design experiments, microgenetic experiments, case studies and so on. Process-analytic methods can reveal the fine details of an individual's learning trajectory and permit the effects of short-timescale interventions upon longer term learning outcomes to be assessed. In this paper, three illustrations of technology-enhanced research (TER) are described. The first example (switchER) illustrates an iterative learner-centred design cycle. The second example (Hyperproof) illustrates how process data can elucidate individual differences in learning. The third example (PATSy, VL-PATSy) demonstrates how an established online e-learning system can be used as a tool for identifying students' clinical reasoning difficulties and how it can then be extended by having additional learning support resources added to it together with a context-sensitive, rule-based delivery system. The paper concludes with a discussion of broader TER issues such as the need to anticipate and plan for the analysis of large amounts of rich data. It concludes by suggesting some further ways in which TER might be exploited and provides links to some potentially useful TER tools and resources.

show abstract

“…Several client-side event logging systems have been developed by researchers, but all have been simple keyboard and mouse loggers. These include Datalogger (Westerman et al, 1996) for Windows 3.1 and DOS; InputLogger (Trewin, 1998) for the Apple Macintosh; and RUI (Kukreja, Stevenson, & Ritter, 2006) for Windows and Mac OS X. All of these examples provide timing logs for keystrokes, mouse clicks, and mouse moves, but none provide information regarding the semantics of the application and the user's action, such as the name of the button that was pressed, the state of the scrollbar, the current interface view, and so on.…”

mentioning

confidence: 99%

AppMonitor: A tool for recording user actions in unmodified Windows applications

Alexander

Cockburn

Lobb

2008

Behavior Research Methods

View full text Add to dashboard Cite

Interface designers and human-computer interaction (HCI) researchers need to understand how users interact with systems in order to improve them. Several strategies are commonly used to gain such insights, including controlled experiments run in research labs, field studies, and contextual inquiry (Holtzblatt & Jones, 1993). Client-side logging of user actions is another technique that has several advantages over other methods: It is highly scalable, since software is easily disseminated over the Web; it is low-cost to the participants and experimenters, because, once it has been installed, the logs are generated and stored automatically; it readily allows longitudinal analysis of weeks, months, or years of use; and it allows finegrain analysis of subsecond events and low-level actions. The two primary disadvantages of client-side logging are, first, that it cannot record the user's high-level goals or context; and second, that developing logging software can be prohibitively complex.The difficulty in implementing logging software has discouraged and impaired its use. For example, in analyzing Web navigation behavior, participants have been asked to abandon their preferred proprietary Web browsers in favor of customized logging versions of open-source software (e.g., Tauscher & Greenberg, 1997) or to use "roll your own" systems (e.g., Kellar, Hawkey, Inkpen, & Watters, in press). Clearly, logging analyses should measure interaction with the users' preferred software rather than with a surrogate that supports a subset of the real system features or that presents the features in a different manner.In this article, we describe AppMonitor, a tool that allows logging of user interaction with unmodified applications running under Microsoft Windows. Once installed, AppMonitor requires no intervention from the user. It silently records all user actions of interest (from low-level mouse movements to the selection of items in combo/ dialog boxes), and periodically uploads them to a remote Web server. AppMonitor's logs provide a terse but semantically rich description of interaction. As well as capturing a description of low-level user events, such as mouse movement and button-or keypresses, it can also record semantic aspects of interaction, discriminating between the different interface components used and their modes. This capability distinguishes AppMonitor's logs from the video logs generated by screen recorders (such as TechSmith's Camtasia Studio, www.techsmith.com), because video logs require human interpretation to determine the semantics connecting their key logs and mouse logs with the video.To assist researchers in developing their own logging software, we explain how we implemented AppMonitor. The following section reviews related work on tools supporting event logging. We then describe AppMonitor's underlying architecture and implementation and give an example of the output it generates. Finally, we provide some preliminary analyses of the total output from our six beta testers, who used AppMonitor to record ...

show abstract

Investigating the human-computer interface using the Datalogger

Abstract: Methods ofgathering user input data for investigations

Cited by 9 publications

References 18 publications

RUI: Recording user input from interfaces under Windows and Mac OS X

RUI: Recording user input from interfaces under Windows and Mac OS X

Technology‐enhanced research: educational ICT systems as research instruments

AppMonitor: A tool for recording user actions in unmodified Windows applications

Contact Info

Product

Resources

About