Gaze controlled games

Isokoski, Poika; Joos, M.; Špakov, Oleg; Martin, Benoît

doi:10.1007/s10209-009-0146-3

Cited by 87 publications

(39 citation statements)

References 8 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…This software feature may be particularly beneficial for individuals who suffer from a degenerative disease that increasingly limits their motion abilities. Future work in this area could be informed by the experience in designing gaze-controlled games reported in the literature [64,65].…”

Section: Discussionmentioning

confidence: 99%

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Kwan

Paquette

Magee

et al. 2013

Univ Access Inf Soc

View full text Add to dashboard Cite

The graphical user interfaces of popular software are often inaccessible to people with severe motion impairments, who cannot use the traditional keyboard and mouse, and require an alternative input device. Reaching for buttons and selecting menu items, in particular, can be difficult for nonverbal individuals with quadriplegia, who control the mousepointer with head motion via a mouse-replacement system. This paper proposes interaction techniques that can be used with mouse-replacement systems and enable the creation of accessible graphical user interfaces. To illustrate these techniques, the paper presents an image editing application, named Camera Canvas, that uses a sliding toolbar as its universal menu controller. The parameters of the toolbar automatically adapt to the movement abilities of the specific user. Individuals with and without disabilities and of a variety of ages were observed using Camera Canvas. It was found that the developed techniques worked across many different movement abilities and experience levels. Then, it was investigated how such techniques could be used to ''retrofit'' existing Windows applications with new graphical user interfaces. A tool called Menu Controller was created that can automatically re-render the menus of some existing applications into adaptive sliding toolbars. Menu Controller enables users of mouse-replacement systems to select menu entries that were otherwise inaccessible to them.

show abstract

Section: Discussionmentioning

confidence: 99%

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Kwan

Paquette

Magee

et al. 2013

Univ Access Inf Soc

View full text Add to dashboard Cite

show abstract

“…When the user focused on objects for a certain duration, the system provided more information regarding the object using synthesized speech. In the last few years there have been an increasing amount of work done in the field of gaze controlled games [5], [18]. Although this work is still in its early stages and there are not many games that support eye tracking technology [5].…”

Section: Related Workmentioning

confidence: 99%

“…The word "maze" had to be substituted for "map", and "select" was also found to be inconsistent as a word to choose menu options. For a more extensive overview of gaze controlled games please see [5,18].…”

Section: Related Workmentioning

confidence: 99%

See 1 more Smart Citation

Gaze and voice controlled drawing

Kamp

Sundstedt

2011

Proceedings of the 1st Conference on Novel Gaze-Controlled Applications

View full text Add to dashboard Cite

Eye tracking is a process that allows an observers gaze to be determined in real time by measuring their eye movements. Recent work has examined the possibility of using gaze control as an alternative input modality in interactive applications. Alternative means of interaction are especially important for disabled users for whom traditional techniques, such as mouse and keyboard, may not be feasible. This paper proposes a novel combination of gaze and voice commands as a means of hands free interaction in a paint style program. A drawing application is implemented which is controllable by input from gaze and voice. Voice commands are used to activate drawing which allow gaze to be used only for positioning the cursor. In previous work gaze has also been used to activate drawing using dwell time. The drawing application is evaluated using subjective responses from participant user trials. The main result indicates that although gaze and voice offered less control that traditional input devices, the participants reported that it was more enjoyable.

show abstract

“…One of the issues of such approaches is what Almeida [23] refers to as the 'Midas touch' problem, where eye gaze vectors are constantly used to issue commands, regardless of whether the user actually intends to do so or merely looks around at the game interface or is producing irrelevant fixations and saccades. To overcome this, several researchers focus on gamer attention and engagement, as a higher-level cognitive concept, based on gaze: Seif El-Nasr [24] uses a commercial head-mounted eye tracker to identify points on a computer screen and then objects in the game world that attract the user's attention, while Sundstedt, Isokoski [25] and Smith [26] use eye gaze to control virtual and game characters. However, these approaches lie in-between those described before and a completely low-cost approach, since they do rely on visual features, but require dedicated eye-tracking hardware to produce them.…”

Section: And Kostas Karpouzismentioning

confidence: 99%

Fusing Visual and Behavioral Cues for Modeling User Experience in Games

Shaker

Asteriadis

Yannakakis

et al. 2013

IEEE Trans. Cybern.

View full text Add to dashboard Cite

Abstract-Estimating affective and cognitive states in conditions of rich human-computer interaction, such as in games, is a field of growing academic and commercial interest. Entertainment and serious games can benefit from recent advances in the field as, having access to predictors of the current state of the player (or learner) can provide useful information for feeding adaptation mechanisms that aim to maximize engagement or learning effects. In this paper, we introduce a large data corpus derived from 58 participants that play the popular Super Mario Bros platform game and attempt to create accurate models of player experience for this game genre. Within the view of the current research, features extracted both from player gameplay behavior and game levels, and player visual characteristics have been used as potential indicators of reported affect expressed as pairwise preferences between different game sessions. Using neuroevolutionary preference learning and automatic feature selection, highly accurate models of reported engagement, frustration, and challenge are constructed (model accuracies reach 91%, 92% and 88% for engagement, frustration and challenge, respectively). As a step further, the derived player experience models can be used to personalize the game level to desired levels of engagement, frustration and challenge, as game content is mapped to player experience through the behavioral and expressivity patterns of each player.

show abstract

Gaze controlled games

Cited by 87 publications

References 8 publications

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Adaptive sliding menubars make existing software more accessible to people with severe motion impairments

Gaze and voice controlled drawing

Fusing Visual and Behavioral Cues for Modeling User Experience in Games

Contact Info

Product

Resources

About