Web AR Solution for UAV Pilot Training and Usability Testing

Abstract

Data and services are available anywhere at any time thanks to the Internet and mobile devices. Nowadays, there are new ways of representing data through trendy technologies such as augmented reality (AR), which extends our perception of reality through the addition of a virtual layer on top of real-time images. The great potential of unmanned aerial vehicles (UAVs) for carrying out routine and professional tasks has encouraged their use in the creation of several services, such as package delivery or industrial maintenance. Unfortunately, drone piloting is difficult to learn and requires specific training. Since regular training is performed with virtual simulations, we decided to propose a multiplatform cloud-hosted solution based in Web AR for drone training and usability testing. This solution defines a configurable trajectory through virtual elements represented over barcode markers placed on a real environment. The main goal is to provide an inclusive and accessible training solution which could be used by anyone who wants to learn how to pilot or test research related to UAV control. For this paper, we reviewed drones, AR, and human–drone interaction (HDI) to propose an architecture and implement a prototype, which was built using a Raspberry Pi 3, a camera, and barcode markers. The validation was conducted using several test scenarios. The results show that a real-time AR experience for drone pilot training and usability testing is achievable through web technologies. Some of the advantages of this approach, compared to traditional methods, are its high availability by using the web and other ubiquitous devices; the minimization of technophobia related to crashes; and the development of cost-effective alternatives to train pilots and make the testing phase easier for drone researchers and developers through trendy technologies.

Smart Mobile Application for Short-Haul Cargo Transportation

“…As a result, a web-based platform was developed as the design solution by the design thinking approach. The design solution went through usability testing by potential actual users, and their feedback and evaluations were reconfigured in modifying the features and functions [37]. Figure 2 illustrates the adapted design science approach that was followed in this work [30,33,36].…”

Using Augmented Reality and Drones in Tandem to Serve Smart Cities

“…The functions of the tactile Internet include the delivery of information over the network about the impact on an object located at a distant distance and the transmission of a response back. Obviously, with such an exchange of data, the delivery delay should be as low as possible (Ribeiro et al, 2021).…”

Locomotion-Based UAV Control Toward the Internet of Senses

“…Understanding the user's experience when interacting with UAVs makes it possible to design and optimize these devices to meet users' needs better. For example, UAVs equipped with cameras and computer vision algorithms can create an augmented reality experience, allowing users to view and interact with digital content in the context of the real world [5]. Furthermore, UAVs equipped with microphones and speech recognition technology can create voice-controlled interfaces for controlling the UAV or other applications.…”