Comparing selection mechanisms for gaze input techniques in head-mounted displays

Esteves, Augusto; Shin, Yonghwan; Oakley, Ian

doi:10.1016/j.ijhcs.2020.102414

Cited by 35 publications

(19 citation statements)

References 10 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…18 papers were considered only relevant to a specific implementation, whereas 12 explored fundamental findings and went on to apply them to a final application. Notable areas of contribution surround selection [12,26,30], object manipulation [20,63,90], text entry [48,95], game interaction [14,82], character control and animation [3,96], human-human [86] and human-robot collaboration [31,43], map exploration [76], UI (user interface) and menu-based interaction [8,67], Medical/Healthcare [68,74], interactive learning [9,57] and AR assistants [51,99]. Some studies could be classified into more than one of these categories, such as the work of Sadri et al [74], which focuses on anatomic model manipulation for medical applications.…”

Section: Type Of Studymentioning

confidence: 99%

A Review of Interaction Techniques for Immersive Environments

Spittle

Frutos-Pascual

Creed

et al. 2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

The recent proliferation of immersive technology has led to the rapid adoption of consumer-ready hardware for Augmented Reality (AR) and Virtual Reality (VR). While this increase has resulted in a variety of platforms that can offer a richer interactive experience, the advances in technology bring more variability in display types, interaction sensors and use cases. This provides a spectrum of device-specific interaction possibilities, with each offering a tailor-made solution for delivering immersive experiences to users, but often with an inherent lack of standardisation across devices and applications. To address this, a systematic review and an evaluation of explicit, task-based interaction methods in immersive environments are presented in this paper. A corpus of papers published between 2013 and 2020 is reviewed to thoroughly explore state-of-the-art user studies, which investigate input methods and their implementation for immersive interaction tasks (pointing, selection, translation, rotation, scale, viewport, menu-based and abstract). Focus is given to how input methods have been applied within the spectrum of immersive technology (AR, VR, XR). This is achieved by categorising findings based on display type, input method, study type, use case and task. Results illustrate key trends surrounding the benefits and limitations of each interaction technique and highlight the gaps in current research. The review provides a foundation for understanding the current and future directions for interaction studies in immersive environments, which, at this pivotal point in XR technology adoption, provides routes forward for achieving more valuable, intuitive and natural interactive experiences.

show abstract

Section: Type Of Studymentioning

confidence: 99%

A Review of Interaction Techniques for Immersive Environments

Spittle

Frutos-Pascual

Creed

et al. 2023

IEEE Trans. Visual. Comput. Graphics

View full text Add to dashboard Cite

show abstract

“…A study demonstrated that each technique has their strength and weaknesses. Esteves et al present a study comparing selection techniques for head based pointing [12], finding that handsfree (dwell time) and hands-on (using manual input) are most promising.…”

Section: Gaze Interaction In Vrmentioning

confidence: 99%

Empirical Evaluation of Gaze-enhanced Menus in Virtual Reality

Pfeuffer

Mecke

Rodriguez

et al. 2020

26th ACM Symposium on Virtual Reality Software and Technology

View full text Add to dashboard Cite

Many user interfaces involve attention shifts between primary and secondary tasks, e.g., when changing a mode in a menu, which detracts the user from their main task. In this work, we investigate how eye gaze input affords exploiting the attention shifts to enhance the interaction with handheld menus. We assess three techniques for menu selection: dwell time, gaze button, and cursor. Each represents a different multimodal balance between gaze and manual input. We present a user study that compares the techniques against two manual baselines (dunk brush, pointer) in a compound colour selection and line drawing task. We show that user performance with the gaze techniques is comparable to pointer-based menu selection, with less physical effort. Furthermore, we provide an analysis of the trade-off as each technique strives for a unique balance between temporal, manual, and visual interaction properties. Our research points to new opportunities for integrating multimodal gaze in menus and bimanual interfaces in 3D environments. CCS CONCEPTS • Human-centered computing → Human computer interaction (HCI); Virtual reality; Mixed / augmented reality.

show abstract

“…Desde então, talvez pela popularização da ISO 9241-9 como instrumento de avaliação de interfaces para 2D, alguns autores buscaram aplicar métodos de teste semelhantes para o caso tridimensional. É possível encontrar uma multitude de trabalhos que utilizam fundamentos da Lei de Fitts e a ISO 9241-411 para avaliar interação 3D tanto em telas bidimensionais quanto para ambientes virtuais tridimensionais como os da RV (WARE; LOWTHER, 1997;TEATHER et al, 2009;KOUROUPETROGLOU et al, 2012;PINO et al, 2013;BURNO et al, 2015;MACKENZIE, 2017;HANSEN et al, 2018;OAKLEY, 2020). Porém, a ausência de um método padronizado di culta a comparação entre resultados de diferentes estudos.…”

Section: Avaliação De Técnicas De Interação Com As Mãos Em 3dunclassified

“…Researchers have explored a range of input modalities for interacting with 3D environments, such as 3D controllers Kouroupetroglou et al, 2012), gaze and head movement (Esteves et al, 2020), and3D gestural interaction (LaViola, 2013). Each of them has its own benefits and drawbacks and combining them in a multimodal interface can result in a better solution (Van Krevelen and Poelman, 2010).…”

Section: Introductionmentioning

confidence: 99%

“…Fitts' Law has been widely used as an evaluation tool for 2D interaction (Soukoreff and MacKenzie, 2004). It has also been used to evaluate 3D interaction in both 2D displays and in Virtual Reality (VR) environments (Ware and Lowther, 1997;Teather et al, 2009Kouroupetroglou et al, 2012;Pino et al, 2013;Burno et al, 2015;Hansen et al, 2018;Esteves et al, 2020). Still, to the best of our knowledge, it has never been studied for interaction in an AR OST-HMD.…”

Section: Introductionmentioning

confidence: 99%

See 1 more Smart Citation

Avaliação do desempenho de técnicas de interação com as mãos em realidade aumentada imersiva.

Couto¹

View full text Add to dashboard Cite

Aprendi com este trabalho que realizar uma pesquisa cientí ca exige, além de habilidade para conciliar os diversos desejos e interesses da mente humana, capacidade para encontrar, processar e organizar uma elevada quantidade de informações. Eu sabia que desenvolver este tipo de trabalho não seria trivial, mas em nenhum momento eu havia imaginado que o processo seria tão longo e tão exaustivo -cognitiva e emocionalmente -como foi. De fato, a conclusão deste trabalho só foi possível graças a uma rede de apoios de diferentes naturezas que recebi ao longo deste percurso, e a ela deixo meus sinceros agradecimentos.Agradeço à minha orientadora, Prof. a Dra. Roseli de Deus Lopes, pelas horas de orientação, pela paciência nos momentos em que eu estive impaciente e pelo entendimento, consolo e estímulo quando minhas energias faltaram. Agradeço ao Dr. Marcelo Archanjo José, pelas horas dedicadas em discussões produtivas nas diversas etapas deste trabalho, tais como aprovação do Comitê de Ética em Pesquisa, delineamentos experimentais, análise de dados e organização geral das informações.Agradeço ao Centro Interdisciplinar de Pesquisas Interativas (CITI-USP), pelo acesso ao seu espaço, equipamentos e expertise pro ssional, que foram essenciais nas fases de exploração tecnológica e condução dos experimentos descritos neste trabalho.Agradeço aos 12 participantes voluntários que cederam seu tempo, paciência e energia, para colaborarem com os experimentos realizados nesta investigação cientí ca.Agradeço à toda equipe do LSI-TEC, pelas dicas sobre o como trilhar o percurso acadêmico, pelo tempo dedicado e considerações feitas na prévia da minha apresentação de quali cação, e pelos cafés quando eu precisava espairecer.Agradeço ao Professor Doutor Scott Mackenzie (Universidade de York), por gentilmente ter fornecido o código fonte do programa GoFitts, utilizado como referência neste trabalho.Agradeço ao Conselho Nacional de Desenvolvimento Cientí co e Tecnológico (CNPq), pela concessão de bolsa de mestrado (processo número 167205/2017-0).Agradeço ao meu amigo Andy, por ter aplicado seus conhecimentos especializados, empenhado tempo e esforços para me ajudar a produzir uma gura maravilhosa que ilustrou muito bem este estudo cientí co.Por m, agradeço àqueles que, apesar de não contribuírem diretamente para o conteúdo deste trabalho, indiretamente criaram as condições afetivas, emocionais, materiais e ambientais para que eu pudesse escrever um manuscrito de artigo original e esta dissertação: meus pais, minha avó, meus irmãos e meus amigos.

show abstract

Comparing selection mechanisms for gaze input techniques in head-mounted displays

Cited by 35 publications

References 10 publications

A Review of Interaction Techniques for Immersive Environments

A Review of Interaction Techniques for Immersive Environments

Empirical Evaluation of Gaze-enhanced Menus in Virtual Reality

Avaliação do desempenho de técnicas de interação com as mãos em realidade aumentada imersiva.

Contact Info

Product

Resources

About