Augmented visualization with natural feature tracking

Abstract

Visualization systems often require large monitors or projection screens to display complex information. Even very sophisticated systems that exhibit complex user interfaces do usually not exploit advanced input and output devices. One of the reasons for that is the high cost of special hardware. This paper introduces Augmented Visualization, an interaction method for projection walls as well as monitors using affordable and widely available hardware such as mobile phones or tablets. The main technical challenge is the tracking of the users' devices without any special equipment or fiducial markers in the working area. We propose to track natural features of the display content with the built-in camera of mobile devices. Tracking the visualized scene allows pose estimation of the mobile devices with six degrees of freedom. The position and orientation information is then used for advanced interaction metaphors like magic lenses. For a group of experts who are analyzing the data in front of the same screen, a personal augmented view of the visualized scene is presented, for each user on his/her personal device. The prototype Augmented Visualization System achieves interactive frame rates and may lead to a greatly enhanced user experience. The paper discusses the design and implementation questions and illustrates potential application scenarios.

Augmented Reality Markerless Multi-Image Outdoor Tracking System for the Historical Buildings on Parliament Hill

“…The vision-based approach is another markerless solution that relies on computer vision and provides very accurate tracking, although it can be unstable as it depends on natural-feature detection. This method is explained in several papers [17][18][19][20] and is based on keypoint extraction and feature descriptors to calculate the pose estimation. This approach has been applied for the augmentation of the urban environment [21] or in object detection in uncontrolled outdoor environments [22].…”

Merging Photogrammetry and Augmented Reality: The Canadian Library of Parliament

“…The app presents a complete marker-less tracking solution (Uchiyama and Marchand, 2012). Our approach is based on the recognition of natural features points (Blanco-Pons et al, 2018;Sörös et al, 2011) which are visible in the environment and image tracking solution. We used our own image of the target as tracker (Figure 3) which fulfills the main conditions to be a good tracker, i.e.…”

Augmented reality application assessment for disseminating rock art

“…Whenever the user moves the AR device, the tracking system recalculates the new pose in real time and thus the virtual contents have to remain aligned with the real object. The camera pose is calculated with six degrees of freedom, three translation parameters x, y, z and three orientation parameters yaw, pitch, roll [23].…”