Cooperation of Virtual Reality and Real Objects with HoloLens

Cýrus, Jindřich; Kapp, David; Petrů, Michal; Koci, Jan

doi:10.1007/978-3-030-17798-0_10

Cited by 9 publications

(3 citation statements)

References 15 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The assessment of accuracy and precision in the representation of movable virtual objects is an opportunity to extend this research, which is currently limited to measuring these indicators for static virtual objects. The studies by Cýrus et al [21] indicate that the recognition of fiducial markers is a more suitable alternative for representing mobile virtual objects; however, the analysis of the characteristics that favor the recognition of markers is associated with the field of computer vision and is outside this study scope.…”

Section: Discussionmentioning

confidence: 95%

Three-Dimensional Coordinate Calibration Models for Augmented Reality Applications in Indoor Industrial Environments

Nunes,

Almeida,

Silva

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

The calibration of three-dimensional (3D) coordinates in augmented reality systems is a complex activity. It involves the recognition of environmental characteristics and technology that models the 3D space of the device, determining its position and orientation. Single markers suffer from numerical instability, particularly when they are small within the camera image. In the industrial environment, it is common for augmented reality applications to cover large spaces, making it difficult to maintain attributes such as precision and accuracy. To address this issue, our study proposes a two-step calibration model that leverages multiple markers for accurate localization in a larger indoor environment. We developed the calibration model using Unity3D, Mixed Reality ToolKit, and Vuforia and evaluated it in terms of precision and accuracy in a proof of concept using the MS Hololens device. Our findings reveal that employing two markers significantly reduces angular discrepancies between points in the real and augmented environments. Moreover, our results underscore that registration accuracy improves as the number of calibration points increases. The results show improvements in determining the axes that define the 3D space, with a direct influence on the position of the points observed in the experiment.

show abstract

Section: Discussionmentioning

confidence: 95%

Three-Dimensional Coordinate Calibration Models for Augmented Reality Applications in Indoor Industrial Environments

Nunes,

Almeida,

Silva

et al. 2023

Applied Sciences

View full text Add to dashboard Cite

show abstract

“…Then, we used singular value decomposition (SVD) to solve

{G_{ij}}

to obtain the following 17 :

\begin{equation}G\ = \ TD{U^T}\end{equation}

…”

Section: Methodsmentioning

confidence: 99%

Augmented reality surgical navigation system based on the spatial drift compensation method for glioma resection surgery

et al. 2022

View full text Add to dashboard Cite

Background The number of patients who suffer from glioma has been increasing, and this malignancy is a serious threat to human health. The mainstream treatment for glioma is surgical resection; therefore, accurate resection can improve postoperative patient recovery. Purpose Many studies have investigated surgical navigation guided by mixed reality, with good outcomes. However, the limitations of mixed reality, such as spatial drift caused by environmental changes, limit its clinical application. Therefore, we present a mixed reality surgical navigation system for glioma resection. Preoperative information can be fused precisely with the real patient with the spatial compensation method to achieve clinically suitable accuracy. Methods A head‐mounted device was used to display virtual information, and a markerless spatial registration method was applied to precisely align the virtual anatomy with the real patient preoperatively. High‐accuracy preoperative and intraoperative movement and spatial drift compensation methods were used to increase the positional accuracy of the mixed reality‐guided glioma resection system when the patient's head is fixed to the bed frame. Several experiments were designed to validate the accuracy and efficacy of this system. Results Phantom experiments were performed to test the efficacy and accuracy of this system under ideal conditions, and clinical tests were conducted to assess the performance of this system in clinical application. The accuracy of spatial registration was 1.18 mm in the phantom experiments and 1.86 mm in the clinical application. Conclusions Herein, we present a mixed reality‐based multimodality‐fused surgical navigation system for assisting surgeons in intuitively identifying the glioma boundary intraoperatively. The experimental results indicate that this system has suitable accuracy and efficacy for clinical usage.

show abstract

“…Utilizing it demands increased application memory and may introduce potential overhead due to additional graphic and physics processing, particularly when used continuously. AR development platforms such as Vuforia could be used together with MR devices to support object recognition [15]. In this scenario, Vuforia could be used to recognize physical objects or images in the environment when viewed though the Hololens 2 camera, which triggers holographic overlays or interactions related to the recognized objects.…”

Section: Target Creationmentioning

confidence: 99%

HandyNotes: using the hands to create semantic representations of contextually aware real-world objects

Quere,

Menin,

Julien

et al. 2024

2024 IEEE Conference Virtual Reality and 3D User Interfaces (VR)

View full text Add to dashboard Cite

HAL is a multi-disciplinary open access archive for the deposit and dissemination of scientific research documents, whether they are published or not. The documents may come from teaching and research institutions in France or abroad, or from public or private research centers. L'archive ouverte pluridisciplinaire HAL, est destinée au dépôt et à la diffusion de documents scientifiques de niveau recherche, publiés ou non, émanant des établissements d'enseignement et de recherche français ou étrangers, des laboratoires publics ou privés.

show abstract

Cooperation of Virtual Reality and Real Objects with HoloLens

Cited by 9 publications

References 15 publications

Three-Dimensional Coordinate Calibration Models for Augmented Reality Applications in Indoor Industrial Environments

Three-Dimensional Coordinate Calibration Models for Augmented Reality Applications in Indoor Industrial Environments

Augmented reality surgical navigation system based on the spatial drift compensation method for glioma resection surgery

HandyNotes: using the hands to create semantic representations of contextually aware real-world objects

Contact Info

Product

Resources

About