Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

Kim, Joo Chan; Laine, Teemu H.; Åhlund, Christer

doi:10.3390/app11041738

Cited by 35 publications

(12 citation statements)

References 54 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…Based on the above analysis, we can see that augmented reality technology can be widely used in different fields. In order to further illustrate the content of the consistency test of augmented reality technology [13,14]. First, the quantized local features are used for feature matching to obtain the matching relationship between the optimized image sample and the query image.…”

Section: Consistencymentioning

confidence: 99%

Analysis of Artistic Creation and Design Methods in Universities Based on Augmented Reality and 5G Communication Technology

2022

Security and Communication Networks

View full text Add to dashboard Cite

In order to enhance the research of art design in colleges and universities, based on the theory of augmented reality, 5G communication technology is used to conduct targeted analysis of art design and creation in colleges and universities. Through the research of feature parameter extraction, parameter consistency test, and optimization algorithm analysis on the relevant data of the art design in colleges and universities, the deficiencies of art design and creation in colleges and universities are pointed out, and relevant solutions are adopted. The results show that with the increase of distribution distance, the curve of the z value shows a linear change trend. The curve corresponding to a value has an obvious polynomial change rule. Through the analysis, it can be seen that the influence of two parameters on augmented reality needs to be considered comprehensively. As the number of iterative steps increases, the consistency curve of augmented reality shows an obvious linear downward trend. However, the increase of parameter m can improve the data changes of augmented reality consistency, and the research shows that parameter m can further promote the consistency changes of augmented reality. The gradual increase of index Pn leads to a gradual decline in data Pc, while the parameter Px has an opposite effect on data Pc. Therefore, in order to obtain targeted data and results of 5G communication technology, it is necessary to comprehensively consider the influence of the two factors. Finally, the optimization model based on augmented reality and 5G communication technology is used to analyze and predict the relevant characteristic data of university art design, so as to verify the accuracy of the model. The research results can provide support for the application of augmented reality and 5G communication technology in other art fields.

show abstract

Section: Consistencymentioning

confidence: 99%

Analysis of Artistic Creation and Design Methods in Universities Based on Augmented Reality and 5G Communication Technology

2022

Security and Communication Networks

View full text Add to dashboard Cite

show abstract

“…The real world that is augmented is already smart. In recent papers, we see this awareness gaining attention, for example in [39], a review on the convergence of AR, intelligent agents, the IoT, and AI, in [40], a survey on the integration of AR and IoT, and a review in [41] on the combination of AR and IoT. It shows that the use of AR will be integrated with our daily activities, including our social activities, in an already smart world.…”

Section: Discussionmentioning

confidence: 99%

Social Augmented Reality: A Multiperspective Survey

Nijholt

2021

2021 Joint 10th International Conference on Informatics, Electronics &Amp; Vision (ICIEV) and 2021 5th International Conference

View full text Add to dashboard Cite

We introduce research on social augmented reality with an emphasis on social face-to-face interaction. In social interaction interactants employ knowledge about their conversational partner and have their verbal interaction supported by nonverbal interaction cues. We survey the issues that arise when we pursue social interaction in augmented reality. Since handhelds and bulky head-mounted devices hardly allow unobtrusive interaction we pay extensive attention to developments in the field of smart glasses and smart contact lenses. The focus is on the use of smart augmented reality glasses during social interactions. Acceptance issues and disruption of social interaction due to the use of these devices are also touched upon. Contribution-An overview of social aspects of interpersonal communication in augmented reality applications.

show abstract

“…That was a reverse process. For example, the sign language coding system SignWriting divides the flexion of finger PIP into three basic states: straight, bend, and curve [ 3 ]. The result of the division is that these three states were needed in sign language expression, and these three states are also sufficient to cover all sign language actions.…”

Section: Discussionmentioning

confidence: 99%

“…As a natural form of semantic expression, gesture occupies an important position in the field of multimodal interaction [ 1 , 2 , 3 ]. Due to the limited range of hand joint motion and the discrete perception of the state, the continuous movement of a hand motion primitive unit only contains a limited number of semantic states.…”

Section: Introductionmentioning

confidence: 99%

Research on Discrete Semantics in Continuous Hand Joint Movement Based on Perception and Expression

Jia

Qin

Bai

et al. 2021

Sensors

View full text Add to dashboard Cite

Continuous movements of the hand contain discrete expressions of meaning, forming a variety of semantic gestures. For example, it is generally considered that the bending of the finger includes three semantic states of bending, half bending, and straightening. However, there is still no research on the number of semantic states that can be conveyed by each movement primitive of the hand, especially the interval of each semantic state and the representative movement angle. To clarify these issues, we conducted experiments of perception and expression. Experiments 1 and 2 focused on perceivable semantic levels and boundaries of different motion primitive units from the perspective of visual semantic perception. Experiment 3 verified and optimized the segmentation results obtained above and further determined the typical motion values of each semantic state. Furthermore, in Experiment 4, the empirical application of the above semantic state segmentation was illustrated by using Leap Motion as an example. We ended up with the discrete gesture semantic expression space both in the real world and Leap Motion Digital World, containing the clearly defined number of semantic states of each hand motion primitive unit and boundaries and typical motion angle values of each state. Construction of this quantitative semantic expression will play a role in guiding and advancing research in the fields of gesture coding, gesture recognition, and gesture design.

show abstract

Multimodal Interaction Systems Based on Internet of Things and Augmented Reality: A Systematic Literature Review

Cited by 35 publications

References 54 publications

Analysis of Artistic Creation and Design Methods in Universities Based on Augmented Reality and 5G Communication Technology

Analysis of Artistic Creation and Design Methods in Universities Based on Augmented Reality and 5G Communication Technology

Social Augmented Reality: A Multiperspective Survey

Research on Discrete Semantics in Continuous Hand Joint Movement Based on Perception and Expression

Contact Info

Product

Resources

About