Virtual co-location to support remote assistance for inflight maintenance in ground training for space missions

Datcu, Dragoş; Cidota, Marina A.; Lukosch, Stephan; Oliveira, David Martínez; Wolff, M.

doi:10.1145/2659532.2659647

Cited by 18 publications

(12 citation statements)

References 11 publications

Supporting

Mentioning

Contrasting

Unclassified

Order By: Relevance

“…Since the content alignment was done on GPS, the use of this system was limited to outdoor contexts. Apart from these works, there are many other examples of collaborative systems that can be divided according to their area of application: Industrial [15,16], Architecture and Construction [14,17], Education and training [18,19] and Entertaining [20,21]. An exhaustive review of collaborative systems based on AR and MR to date has been recently proposed by de Belen et al [22].…”

Section: State Of the Artmentioning

confidence: 99%

SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality

2020

View full text Add to dashboard Cite

Augmented Reality (AR) functionalities may be effectively leveraged in collaborative service scenarios (e.g., remote maintenance, on-site building, street gaming, etc.). Standard development cycles for collaborative AR require to code for each specific visualization platform and implement the necessary control mechanisms over the shared assets. in order to face this challenge, this paper describes SARA, an architecture to support cross-platform collaborative Augmented Reality applications based on microservices. The architecture is designed to work over the concept of collaboration models which regulate the interaction and permissions of each user over the AR assets. Five of these collaboration models were initially integrated in SARA (turn, layer, ownership, hierarchy-based and unconstrained examples) and the platform enables the definition of new ones. Thanks to the reusability of its components, during the development of an application, SARA enables focusing on the application logic while avoiding the implementation of the communication protocol, data model handling and orchestration between the different, possibly heterogeneous, devices involved in the collaboration (i.e., mobile or wearable AR devices using different operating systems). to describe how to build an application based on SARA, a prototype for HoloLens and iOS devices has been implemented. the prototype is a collaborative voxel-based game in which several players work real time together on a piece of land, adding or eliminating cubes in a collaborative manner to create buildings and landscapes. Turn-based and unconstrained collaboration models are applied to regulate the interaction. the development workflow for this case study shows how the architecture serves as a framework to support the deployment of collaborative AR services, enabling the reuse of collaboration model components, agnostically handling client technologies.Appl. Sci. 2020, 10, 2074 2 of 26 wearable ones). SARA is also able to automatically orchestrate the rules for the collaboration policy needed for the target application. To do so, we defined a set of collaboration models which implement the most frequent collaboration strategies, such as turn-based, layer-based and hierarchy-based ones. Finally, the architecture facilitates the adaptation of non-collaborative applications to make them collaborative, and even to turn those non-AR applications into AR ones. SARA architecture is tested in this paper through a case-based methodology-technology empirical evaluation-to complete a proof-of-concept validation. The case under study is the development of a voxel-based collaborative game, which is implemented to demonstrate the development life-cycle and the management of unconstrained and turn-based collaboration models.This paper is structured as follows. First, in Section 2 we provide an overview of the current state of the art regarding AR collaborative systems as well as collaborative Augmented Reality architectures. In Section 3 we present an analysis of the collaboration over A...

show abstract

Section: State Of the Artmentioning

confidence: 99%

SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality

2020

View full text Add to dashboard Cite

show abstract

“…The game setup provides support for studying the two types of AR based collaboration: the co-located cooperative interaction with skilled workers, each having a different view of the AR world and the indirect interaction with remote expert that has the same view as the skilled worker. In a similar way, Datcu et al [4] [5] propose an AR based scenario of playing a game collaboratively, to study complex problem solving by physically co-located and virtually co-located participants. Within the game, the goal of jointly building a tower of coloured blocks represents an approximation of a shared task.…”

Section: Related Workmentioning

confidence: 99%

“…Due to its capability to improve perception of reality, to support collaboration, a visual display of virtual objects, and to enable transitions between real and virtual environments, augmented reality (AR) technology can be used to create novel interfaces for face-to-face and remote collaboration for training [5] [6].…”

Section: Introductionmentioning

confidence: 99%

Affective Computing and Augmented Reality for Car Driving Simulators

Datcu

Rothkrantz

2017

APP

View full text Add to dashboard Cite

Abstract. Car simulators are essential for training and for analyzing the behavior, the responses and the performance of the driver. Augmented Reality (AR) is the technology that enables virtual images to be overlaid on views of the real world. Affective Computing (AC) is the technology that helps reading emotions by means of computer systems [1][2][3], by analyzing body gestures, facial expressions, speech and physiological signals. The key aspect of the research relies on investigating novel interfaces that help building situational awareness and emotional awareness, to enable affect-driven remote collaboration in AR for car driving simulators. The problem addressed relates to the question about how to build situational awareness (using AR technology) and emotional awareness (by AC technology), and how to integrate these two distinct technologies [4], into a unique affective framework for training, in a car driving simulator.

show abstract

“…Recently, a number of tablet-based mobile remote guidance systems have emerged (Gauglitz et al 2012(Gauglitz et al , 2014Chen et al 2013) and approaches using seethrough Head Mounted Displays (HMDs) also exist (Ogawa et al 2005;Datcu et al 2014). Our system differs from these in that it uses projected annotations and therefore removes the need for a display device to be in the worker's view.…”

Section: Remote Guidancementioning

confidence: 99%

Using Projected Light for Mobile Remote Guidance

Adcock

Gunn

2015

Comput Supported Coop Work

View full text Add to dashboard Cite

A worker performing a physical task may need to ask for advice and guidance from an expert. This can be a problem if the expert is in some distant location. In this paper, we describe a system which allows the expert to see the workplace from the worker's point of view, and to draw annotations directly into that workplace using a pico-projector. Since the system can be worn by the worker, these projected annotations may move with the worker's movements. We describe a method for sticking these annotations to the original positions thereby compensating for the movement of the worker. We call this 'StickyLight'. We conducted a user study to evaluate the performance and user preference for the system in 'sticky' and freehand ('non-sticky') modes. We also compared the system on two platforms: helmet mounted and tripod mounted. Results indicate that freehand conditions took less time than sticky, and that tripod conditions took less time than helmet. However, participants reported preferences for sticky over non-sticky, likely due to the relative discomfort of keeping the helmet steady. This echoes the findings of several recent similar investigations..

show abstract

Virtual co-location to support remote assistance for inflight maintenance in ground training for space missions

Cited by 18 publications

References 11 publications

SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality

SARA: A Microservice-Based Architecture for Cross-Platform Collaborative Augmented Reality

Affective Computing and Augmented Reality for Car Driving Simulators

Using Projected Light for Mobile Remote Guidance

Contact Info

Product

Resources

About