Mid-Air Browsing and Selection in Image Collections

Koutsabasis, Panayiotis; Domouzis, Chris K.

doi:10.1145/2909132.2909248

Cited by 29 publications

(23 citation statements)

References 18 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These are functional in the sense of providing interactive digital content and gesture tracking and demonstrating a working component of the system, however they are not fully-developed systems. For example, in the work of [54], the elicitation study takes place with reference to a working prototype of an image gallery. Sixteen out of 47 (34%) elicitation studies were conducted with working prototypes.…”

Section: Technological Maturity Of Systemsmentioning

confidence: 99%

“…From our survey, 15 out of 47 (31.9%) studies adopted at least one of the aforementioned techniques to reduce legacy bias, while Production was the most frequent technique used (12 out of 15, 80%). For example, in Reference [51], users were kinaesthetically primed by lifting and moving boxes before the elicitation study, in References [54,55] users were prompted to produce more than 3 gestures for each referent and in Reference [41] users were recruited in groups to brainstorm several interactions and then to come up with the most preferable one.…”

Section: Controlling the Legacy Biasmentioning

confidence: 99%

“…Referents can be presented to the participants in various ways. Depending on the type and maturity of the prototype used, referents were either demonstrated through GUI animations [41,54], described as a text message on the screen, or verbally [4,28,37,61], presented as a video [51,61] or still images [19,24,34,55], or presented by manipulating the actual artefact [7,45].…”

Section: Referent Presentationmentioning

confidence: 99%

“…Although the main method of elicitation studies are similar to Wobbrock's [62,65] or Nielsen's [15] approach, various complementary techniques were employed during the stage of user participation and gesture proposals. The most apparent one is the think-aloud protocol [66,67], which involves prompting participants to verbalize their thoughts, such as why they chose the proposed gesture or refer to other systems or previous experiences [54], as well as describing the gesture, especially the beginning and the end of it. The benefit here is two-fold, it helps the observer to understand the gesture delimiters [68] and it gives valuable insight on the mental models of users [69].…”

Section: Think-aloud Protocolmentioning

confidence: 99%

“…A deeper look into the meaning of "appropriateness" in the papers examined ( Table 5), reveals that a considerable number of studies (14 out of 47, 29.8%) investigate a gesture set that is a "better match" or "fit for purpose" for its intended use (without analysing this into a more specific meaning). For example, elicitation studies were conducted to elicit appropriate gesture sets for controlling a media player [54] or for 3D travelling within a pseudo-universe [59], with the aim improve the user interaction and experience in general. Many elicitation studies focus on finding gestures that are easy to perform (12 out of 47, 25.5%).…”

Section: On Gesture "Appropriateness"mentioning

confidence: 99%

See 4 more Smart Citations

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

Self Cite

View full text Add to dashboard Cite

Mid-air interaction involves touchless manipulations of digital content or remote devices, based on sensor tracking of body movements and gestures. There are no established, universal gesture vocabularies for mid-air interactions with digital content or remote devices based on sensor tracking of body movements and gestures. On the contrary, it is widely acknowledged that the identification of appropriate gestures depends on the context of use, thus the identification of mid-air gestures is an important design decision. The method of gesture elicitation is increasingly applied by designers to help them identify appropriate gesture sets for mid-air applications. This paper presents a review of elicitation studies in mid-air interaction based on a selected set of 47 papers published within 2011-2018. It reports on: (1) the application domains of mid-air interactions examined; (2) the level of technological maturity of systems at hand; (3) the gesture elicitation procedure and its variations; (4) the appropriateness criteria for a gesture; (5) participants number and profile; (6) user evaluation methods (of the gesture vocabulary); (7) data analysis and related metrics. This paper confirms that the elicitation method has been applied extensively but with variability and some ambiguity and discusses under-explored research questions and potential improvements of related research.Multimodal Technologies and Interact. 2018, 2, 65 2 of 21 such thing as a universal gesture vocabulary for every application" [15]. Thus, the identification of appropriate gestures for mid-air user interactions in terms of criteria like discoverability, memorability, performance, reliability and comfort, is an important design decision. This must be made at the early stages of system development and it severely affects the development course of every mid-air application project as well as the user experience (UX) of intended users.Emerging from the field of participatory design, gesture elicitation studies have been widely applied to help designers select the most appropriate gesture set for a given application. Although the method does not have a strict procedure, the main approach is to first define what operations (called "referents") have to be executed through gestures, then ask the end users to propose at least one gesture that they find preferable for each referent and finally to extract the gesture vocabulary after analysing the collected data [16]. The goal of a gesture elicitation study is to extract "good" gestures, which according to Morris et al. [17] are "gestures that meet certain design criteria such as discoverability, ease-of-performance, memorability, or reliability."Over the last few years, several elicitation studies have been conducted to identify mid-air gesture vocabularies for many different application domains and contexts, devices, types of digital content and tracking technologies subsumed. A survey of elicitation studies of mid-air interaction is useful to HCI researchers and interaction designers for deepening th...

show abstract

Section: Technological Maturity Of Systemsmentioning

confidence: 99%

Section: Controlling the Legacy Biasmentioning

confidence: 99%

Section: Referent Presentationmentioning

confidence: 99%

Section: Think-aloud Protocolmentioning

confidence: 99%

Section: On Gesture "Appropriateness"mentioning

confidence: 99%

See 3 more Smart Citations

Gesture Elicitation Studies for Mid-Air Interaction: A Review

Vogiatzidakis

Koutsabasis

2018

MTI

Self Cite

View full text Add to dashboard Cite

show abstract

The role of digital interactive technology in cultural heritage learning: Evaluating a mid‐air gesture‐based interactive media of Ruihetu

Luo

Wang

2022

Computer Animation & Virtual

View full text Add to dashboard Cite

In this study, we investigate the role of mid-air gesture-based interaction technologies in cultural heritage learning. In an experiment, a mid-air gesture-based interactive media for Chinese Song Dynasty traditional painting-Ruihetu was developed and validated. Participants tested three experimental conditions: video learning only; interactive experience first, then video learning; and video learning first, then interactive experience. According to the research results, the outcomes of participants' learning of this cultural heritage differed significantly across all three experimental conditions. This study's findings offer insights into cultural learning of Chinese traditional painting in museums using mid-air gesture-based technology, specifically that video learning exhibits should be combined with and preceded by multimedia interactive exhibits for improved memory and understanding.

show abstract