Gleam

Prakash, Siddhant; Bahremand, Alireza; Nguyen, Linda D.; LiKamWa, Robert

doi:10.1145/3307334.3326098

Cited by 21 publications

(1 citation statement)

References 20 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The second app shares the lighting estimation, encoding environmental illumination towards rendering virtual objects realistically. Multiple AR users could share radiance samples from multiple perspectives to achieve more accurate lighting estimation for more immersive rendering [44]. The third app shares the AR point cloud, which contains the 3D visual corner points that are used to track the space.…”

Section: Benchmark Applicationsmentioning

confidence: 99%

LensCap

Iosifescu

LiKamWa

2021

Proceedings of the 19th Annual International Conference on Mobile Systems, Applications, and Services

Self Cite

View full text Add to dashboard Cite

Augmented Reality (AR) enables smartphone users to interact with virtual content spatially overlaid on a continuously captured physical world. Under the current permission enforcement model in popular operating systems, AR apps are given Internet permission at installation time, and request camera permission and external storage write permission at runtime through a user's approval. With these permissions granted, any Internet-enabled AR app could silently collect camera frames and derived visual information for malicious intent without a user's awareness. This raises serious concerns about the disclosure of private user data in their living environments.To give users more control over application usage of their camera frames and the information derived from them, we introduce LensCap, a split-process app design framework, in which the app is split into a camera-handling visual process and a connectivityhandling network process. At runtime, LensCap manages secured communications between split processes, enacting fine-grained data usage monitoring. LensCap also allows both processes to present interactive user interfaces. With LensCap, users can decide what forms of visual data can be transmitted to the network, while still allowing visual data to be used for AR purposes on device. We prototype LensCap as an Android library and demonstrate its usability as a plugin in Unreal Engine. Performance evaluation results on five AR apps confirm that visual privacy can be preserved with an insignificant latency penalty (< 1.3 ms) at 60 FPS. CCS CONCEPTS• Security and privacy → Software security engineering.

show abstract

Section: Benchmark Applicationsmentioning

confidence: 99%