How to evaluate public displays

Abstract

After years in the lab, interactive public displays are finding their way into public spaces, shop windows, and public institutions. They are equipped with a multitude of sensors as well as (multi-) touch surfaces allowing not only the audience to be sensed, but also their effectiveness to be measured. The lack of generally accepted design guidelines for public displays and the fact that there are many different objectives (e.g., increasing attention, optimizing interaction times, finding the best interaction technique) make it a challenging task to pick the most suitable evaluation method. Based on a literature survey and our own experiences, this paper provides an overview of study types, paradigms, and methods for evaluation both in the lab and in the real world. Following a discussion of design challenges, we provide a set of guidelines for researchers and practitioners alike to be applied when evaluating public displays.

Sharing Wishes on Public Displays: Using Technology to Create Social Places

“…Inter-rater reliability was substantial (Cohen's Kappa = 0.75) [25]. We observed the aspects described by Alt et al [2] basing on a literature survey and their expertise on evaluating public displays installations. The aspects were audience behavior around the installation, effectiveness of the installation, social interaction among users, users' acceptance by engaging and inviting others, and people's concerns about their privacy.…”

Understanding future challenges for networked public display systems in community settings

“…Similarly, Ojala et al [35,36] have reflected on their multi-year experience with the UBI-Hotspots and have described the challenges involved in continuously running and maintaining, as well as evaluating networked public displays in urban settings. The general procedures, methods, and tools used in the public display research has been described by Alt et al [4]. When it comes to networked public displays for communities, Memarovic et al [27] have analyzed previous research and have described general implications of having the input and output of networked public displays tethered to a display, or "free to roam" allowing remote posting and viewing of the display content.…”

Mood-Learning Public Display: Adapting Content Design Evolutionarily through Viewers' Involuntary Gestures and Movements

“…So far, direct questions to viewers, such as interviews or questionnaires, have been commonly used for evaluating the content of public display [4]. One major drawback in such direct questions is that much human labor is required for gathering and analyzing the sufficient data of evaluation.…”

“…Vogel et al [9] considered the viewers' behaviors from the aspect of their relative positions and the aspect of their voluntary behaviors of touching screen, for changing levels of detail of the content. Schiavo et al [10] proposed 4 The processing flow of the proposed method and example of recognizing viewers' involuntary behaviors including motion capture and movements (the line with the circle below means his moving direction). First, the system randomly creates a first generation of content designs based on the defined content by the sender.…”