Creating IoT-ready XR-WebApps with Unity3D

Fleck, Philipp; Schmalstieg, Dieter; Arth, Clemens

doi:10.1145/3424616.3424691

Cited by 6 publications

(3 citation statements)

References 30 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…In recent years, there has been a growing interest in localization and positioning technologies. Researchers and practitioners have proposed various technologies, such as using UWB [5,6], augmented reality (AR) [7,8], and wireless IoT through cross-platform development engine [9,10], to address the challenges of indoor localization. This paper reviews the most recent popular localization technologies, as well as localization within UWB technology, which address the challenges of indoor localization and navigation.…”

Section: Literature Reviewmentioning

confidence: 99%

Indoor Positioning System Based on UWB Rapid Integration with Unity Cross Platform Development Engine through IoT

Zikrul Hakiem Ishak,

Sallehuddin Mohamed Haris

2023

JAIT

View full text Add to dashboard Cite

The changes in time have made divergences of endless possibilities in localization technology. Localization in an indoor environment is surely a concerning matter as several shortcomings always arise when dealing with indoor localization. To optimize localization in an indoor environment, tracking a subject’s position in real-time is a certainly vital interest. Challenges in obtaining an accurate position in precise millimetre accuracy whilst the subject perceive visual information rendered in real-time is somewhat always a matter in hand to address in an indoor environment. The main objective of this research is to implement a positioning method in an indoor environment base on ultra-wideband (UWB) technology to obtain position accuracy in millimetres by rapidly integrating with Unity three-dimensional (3D) engine hence obtaining a detailed inertial measurement unit (IMU) data via wireless Message Queuing Telemetry Transport (MQTT) network protocol. The key results of this research should ensure an establishment of an indoor positioning system based on providing the finest selection of positioning and UWB parameters. These fine selections are an important design choice impacting the system’s performance in obtaining an accurate position within the range of 0.15mm to 115mm. The technological benefits involve the innovation of wireless communication based on the internet of things (IoT) concept relevant to the Industrial Revolution 4.0 (IR 4.0) enabling participants to move freely in an indoor environment whilst obtaining accurate and precise positioning coordinates. Future recommendations comprise of real-time two-dimensional (2D) Pozyx Creator Controller integrated with Unity 3D user graphical user interface (GUI) purposes intended for mobile mapping navigations.

show abstract

Section: Literature Reviewmentioning

confidence: 99%

Indoor Positioning System Based on UWB Rapid Integration with Unity Cross Platform Development Engine through IoT

Zikrul Hakiem Ishak,

Sallehuddin Mohamed Haris

2023

JAIT

View full text Add to dashboard Cite

show abstract

“…Unity3D was used in [43] to create a web application in mixed reality. The authors concluded that using web languages (HTML, CSS, and JavaScript) lowered the bar for content creators.…”

Section: Web-based Cultural Heritage Applicationsmentioning

confidence: 99%

Interaction in eXtended Reality Applications for Cultural Heritage

et al. 2022

View full text Add to dashboard Cite

Digital technologies in the modern era are almost mandatory for the presentation of all types of cultural heritage. Virtual depictions of crafts and traditions offer the users the possibility of time travel, taking them to the past through the use of 3D reconstructions of cultural monuments and sites. However, digital resources alone are not enough to adequately present cultural heritage. Additional information on the historical context in the form of stories, virtual reconstructions, and digitized objects is needed. All of this can be implemented using a digital multimedia presentation technique called digital storytelling. Nowadays, an integral part of many museum exhibitions is interactive digital storytelling. This paper gives an overview of the techniques and discusses different means of facilitating interaction on digital storytelling applications for virtual cultural heritage presentations. We describe the ways in which natural interaction and interaction via eXtended Reality (Virtual and Augmented Reality) applications for cultural heritage are made possible. Users will find the stories told through these applications educational and entertaining at the same time. Through user-experience studies, we measure the user edutainment level and present how users react to implemented interactions.

show abstract

“…Simulation through extended reality is gaining more and more attention in manifold domains requiring computer vision like robotic manufacturing [16][17][18], the automotive industry [19,20], video games [21], fitting rooms [22], mulsemedia setups [23], and IoTready WebApps [24], among others. In fact, by creating virtual environments, synthetic training datasets can be generated in a controllable and customizable manner for further solving common computer vision tasks and avoiding the challenges of collecting and annotating data in the real world [25,26].…”

Section: Related Workmentioning

confidence: 99%

Video Processing from a Virtual Unmanned Aerial Vehicle: Comparing Two Approaches to Using OpenCV in Unity

Bustamante¹,

Belmonte

Herrera

et al. 2022

Applied Sciences

View full text Add to dashboard Cite

Virtual reality (VR) simulators enable the evaluation of engineering systems and robotic solutions in safe and realistic environments. To do so, VR simulators must run algorithms in real time to accurately recreate the expected behaviour of real-life processes. This work was aimed at determining a suitable configuration for processing images taken from a virtual unmanned aerial vehicle developed in Unity using OpenCV. To this end, it was focused on comparing two approaches to integrate video processing in order to avoid potential pitfalls such as delays and bottlenecks. The first approach used a dynamic link library (DLL) programmed in C++, and the second an external module programmed in Python. The native DLL ran internally on the same Unity thread, as opposed to the Python module that ran in parallel to the main process and communicated with Unity through the Message Queue Telemetry Transport (MQTT) protocol. Pre-transmission processing, data transmission and video processing were evaluated for a pair of typical image-processing tasks like colour and face detection. The analysis confirmed that running the Python module in parallel does not overload the main Unity thread and achieves better performance than the C++ plugin in real-time simulation.

show abstract

Creating IoT-ready XR-WebApps with Unity3D

Cited by 6 publications

References 30 publications

Indoor Positioning System Based on UWB Rapid Integration with Unity Cross Platform Development Engine through IoT

Indoor Positioning System Based on UWB Rapid Integration with Unity Cross Platform Development Engine through IoT

Interaction in eXtended Reality Applications for Cultural Heritage

Video Processing from a Virtual Unmanned Aerial Vehicle: Comparing Two Approaches to Using OpenCV in Unity

Contact Info

Product

Resources

About