Augmented Reality (AR) has proposed several types of interaction techniques such as 3D interactions, natural interactions, tangible interactions, spatial awareness interactions and multimodal interactions. Usually, interaction technique in AR involve unimodal interaction technique that only allows user to interact with AR content by using one modality such as gesture, speech, click, etc. Meanwhile, the combination of more than one modality is called multimodal. Multimodal can contribute to human and computer interaction more efficient and will enhance better user experience. This is because, there are a lot of issues have been found when user use unimodal interaction technique in AR environment such as fat fingers. Recent research has shown that multimodal interface (MMI) has been explored in AR environment and has been applied in various domain. This paper presents an empirical study of some of the key aspects and issues in multimodal interaction augmented reality, touching on the interaction technique and system framework. We reviewed the question of what are the interaction techniques that have been used to perform a multimodal interaction in AR environment and what are the integrated components applied in multimodal interaction AR frameworks. These two questions were used to be analysed in order to find the trends in multimodal field as a main contribution of this paper. We found that gesture, speech and touch are frequently used to manipulate virtual object. Most of the integrated component in MMI AR framework discussed only on the concept of the framework components or the information centred design between the components. Finally, we conclude this paper by providing ideas for future work involving this field.
Identification of halal products is a challenging issue especially for the Muslim community. Previously, a few researches were conducted to identify halal products using AR technology which enables the end users to scan product to ensure the quality. Further study needs to be conducted in order to investigate augmented reality experience in identifying halal products and beverages for the Muslim community. This paper presents an application to identify halal products based on Malaysian Islamic Development Department (JAKIM) database for Muslim consumers in Malaysia. The core aim of this research is to provide experience to the user regarding the usage of the proposed mobile application based on AR technology. Evaluation of the proposed application by conducted a survey to 22 users, reveals that user can detect a halal status of the products and give knowledge of awareness to have confident in order to choose the halal product.
A Location-based Augmented Reality (LBAR) application leveraging multimodal interaction and adaptive interface based on Islamic tourism information was proposed to enhance user experience while travelling. LBAR has the potential to improve tourist experience and help tourists to access relevant information, thus improving their knowledge regarding touristic destination while increasing levels of their entertainment throughout the process. In LBAR application, Point of Interest (POI) displayed are exposed to the "occlusion problem" where the AR contents are visually redundant and overlapping with one another causing the users to loose valuable information. Previous research have suggested the design of AR POI which help user to see the augmented POI clearly. The user can click on the desired POI but it still displays a large amount of POI. From our best study, there is limitation of research studying on how to minimize the amount of displayed POI based on user's current needs. Therefore, in this paper we suggest to use an adaptive user interface and multimodal interaction to solve this problem. We discussed the process of analysing and designing the user interfaces of previous studies. The proposed mobile solution was presented by explaining the application contents, the combination of adaptive multimodal inputs, system's flow chart and multimodal task definition. Then the user evaluation was conducted to measure the level of satisfaction in terms of the usability of the application. A total of 24 Islamic tourists have participated in this study. The findings revealed that the average SUS score of 75.83 of respondents agree in terms of satisfaction of the LBAR application to be utilized while traveling. Finally, we conclude this paper by providing the suggestion of future works.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.