Multimodal Input for Perceptual User Interfaces

LaViola, Joseph J.; Buchanan, Sarah; Pittman, Corey

doi:10.1002/9781118706237.ch9

Cited by 11 publications

(15 citation statements)

References 84 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Three-dimensional (3D) modeling is a technique used to create a digital model of an object or environment in three dimensions, using computer software capable of producing 3D images based on the data provided (LaViola, 2005). 3D modeling has various benefits, including helping decision making, predicting and visualizing design results or environmental changes, as well as facilitating testing and simulation in various fields ( Salahuddin, 2018 ).…”

mentioning

confidence: 99%

3D Building Visualization Using LOD1 Level Lidar and Orthophoto Data (Case Study: Jalan Tambak Mayor Surabaya)

Putri,

Maulana

2023

IOP Conf. Ser.: Earth Environ. Sci.

View full text Add to dashboard Cite

Surabaya is the second largest city in Indonesia after Jakarta, with a population of more than 2.8 million people. As the second largest city after Jakarta, of course Surabaya is classified as a city with a high population and building density. With this high level of building density, it is necessary to carry out good regional planning. Good regional planning is an important tool in creating cities and regions that are sustainable, environmentally friendly and provide a high quality of life for their residents. It also helps in addressing complex urban challenges and ensuring wise use of resources. Currently, various methods and technologies have developed that make it easier for the government to carry out regional planning. One method that can be used is to carry out 3D city modeling. Three-dimensional (3D) modeling is a technique used to create a digital model of an object or environment in three dimensions, using computer software capable of producing 3D images based on the data provided. Three-dimensional modeling for buildings with LOD1 level utilizes data obtained from field surveys, remote sensing and numerical modeling. Through this research, 3D city modeling was carried out using LiDAR data and aerial photography to analyze the condition of buildings in the Jalan Tambak Mayor area. This approach uses a 3D city model as the basis for analysis using ArcGISPro software. In this research, data updating will be conducted, which involves directly capturing aerial photographs in the field, as the existing aerial photograph data is from 2016 and needs to be renewed. Based on the resulting modeling, the results of 3-dimensional building modeling are shown on a map which is classified into 5 classes with a building height range between 0 - 46 meters.

show abstract

mentioning

confidence: 99%

3D Building Visualization Using LOD1 Level Lidar and Orthophoto Data (Case Study: Jalan Tambak Mayor Surabaya)

Putri,

Maulana

2023

IOP Conf. Ser.: Earth Environ. Sci.

View full text Add to dashboard Cite

show abstract

“…Communication, where the user and system do not speak the same language, for this study would be considered an interpretation task by the user interface, (LaViola Jr., 2017). This means that the system interface has to be fluent in a language that the user understands and can be easily interpreted by the system.…”

Section: Communicatingmentioning

confidence: 99%

“…From this literature review, it seems that while attempts have been made to create a collaborative environment in different media, they do not always convert well from 2D to 3D. Many attempts leave much to be desired given the missing interactions and functions that should be augmented when moved to another medium (Heldal et al, 2006;LaViola Jr., 2017;Patel et al, 2006). This includes input methods that have become inair gesture based and extends to the user interface that is not always intuitive (Bianchi, 2015) and sometimes requires a different UI between platforms.…”

Section: Framing the Researchmentioning

confidence: 99%

“…Consists of two subtasks, one of which is travel; the task of moving from the current location to a new target location and the other being wayfinding (cognitive route planning). (LaViola Jr., 2017).…”

Section: Glossarymentioning

confidence: 99%

“…An approach that uses displays, tracking, and other technologies to immerse the user in a VE (LaViola Jr., 2017).…”

Section: When People Orally Summarize and Describe What They Just Leamentioning

confidence: 99%

See 2 more Smart Citations

Identifying Interactions for Virtual Reality; a Study of Collaboration and Engagement in Different Media

Chin¹

View full text Add to dashboard Cite

Designers use many methods and techniques to develop ideas and quickly generate concepts. Often these include collaboration and engagement with post-it notes. Technology has enabled exercises using post-it notes to be accessed beyond the physical realm, as digital forms of the post-it-note exist in software applications. This study focused on the experience of using collaborative tools for design thinking practices using post-it notes in face-to-face and digital activities in order to discover common features that could be applied in the design of virtual reality design thinking tools. It found that some common activities in face-to-face collaborative design thinking interactions among designers, such as navigation, selection, manipulation, text input, among others differed from interactions in 2D and 3D Virtual Environments. Study participants worked on design thinking exercises in three different teams using three different types of media (face-to-face, 2D digital, and 3D virtual reality). The teams' behaviours were analyzed to identify and classify the different kinds of interactions that took place. Once these interactions were identified, common and unique gestures were grouped for further analysis. Patterns of activity intensity were identified within and across teams, providing the opportunity to make recommendations about features that could be improved to better suit design collaboration and the user experience in virtual reality.

show abstract

Virtual and augmented reality: Human sensory‐perceptual requirements and trends for immersive spatial computing experiences

Bhowmik

2024

J Soc Info Display

View full text Add to dashboard Cite

Building on several decades of research and development, the recent progress in virtual reality (VR) and augmented reality (AR) devices with spatial computing technologies marks a significant leap in human–computer interaction, with applications ranging from entertainment and education to e‐commerce and healthcare. Advances in these technologies promise immersive experiences by simulating and augmenting the real world with computer‐generated digital content. The core objective of the VR and AR systems is to create convincing human sensory perceptions, thereby creating immersive and interactive experiences that bridge the gap between virtual and physical realities. However, achieving true immersion remains a goal, and it necessitates a comprehensive understanding of the neuroscience of human multisensory perception and accurate technical implementations to create a consistency between natural and synthetic sensory cues. This paper reviews the human sensory‐perceptual requirements vital for achieving such immersion, examines the current status and challenges, and discusses potential future advancements.

show abstract

Multimodal Input for Perceptual User Interfaces

Cited by 11 publications

References 84 publications

3D Building Visualization Using LOD1 Level Lidar and Orthophoto Data (Case Study: Jalan Tambak Mayor Surabaya)

3D Building Visualization Using LOD1 Level Lidar and Orthophoto Data (Case Study: Jalan Tambak Mayor Surabaya)

Identifying Interactions for Virtual Reality; a Study of Collaboration and Engagement in Different Media

Virtual and augmented reality: Human sensory‐perceptual requirements and trends for immersive spatial computing experiences

Contact Info

Product

Resources

About