An AR Map Virtual–Real Fusion Method Based on Element Recognition

Wang, Zhangang

doi:10.3390/ijgi12030126

Cited by 2 publications

(1 citation statement)

References 25 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…These prefabs can range from simple visual markers to complex interactive logic and are primarily used to create virtual objects rapidly and consistently within the AR environment. Existing research on AR maps mainly employs computer-vision-based methods for the global registration of prefabricated information and paper maps, thereby achieving high-quality fusion between the virtual and real elements [7][8][9][10][11], as shown in Figure 1. Implementation approaches mainly include 3D registration techniques based on natural features, marker-based 3D registration techniques, and hybrid tracking and registration techniques [12][13][14].…”

Section: Introductionmentioning

confidence: 99%

An Automated Method for Generating Prefabs of AR Map Point Symbols Based on Object Detection Model

Zou,

Xu,

et al. 2023

IJGI

View full text Add to dashboard Cite

Augmented reality (AR) technology enables paper maps to dynamically express three-dimensional geographic information, realizing the fusion of virtual and real information. However, in the current mainstream AR development software, the virtual information usually consists of prefabricated components (prefabs), and the content creation for AR maps heavily relies on manual prefabrication. It leads to repetitive and error-prone prefabrication work, which restricts the design of the dynamic, interactive functions of AR maps. To solve this problem, this paper explored the possibility of automatically generating AR map prefabs using object detection models to establish a data conversion interface from paper maps to AR maps. First, we compared and analyzed various object detection models and selected YOLOv8x to recognize map point symbols. Then, we proposed a method to automatically generate AR map prefabs based on the predicted bounding boxes of the object detection model, which could generate prefabs with corresponding categories and positional information. Finally, we developed an AR map prototype system based on Android mobile devices. We designed an interaction method for information queries in the system to verify the effectiveness of the method proposed in this paper. The validation results indicate that our method can be practically applied to the AR map prefabrication process and can quickly generate AR map prefabs with high information accuracy. It alleviated the repetitive workload established through the manual prefabrication method and had specific feasibility and practicality. Moreover, it could provide solid data support for developing dynamic interactive functions of AR maps.

show abstract