Virtual Reality Telepresence: 360-Degree Video Streaming with Edge-Compute Assisted Static Foveated Compression

Huang, Xincheng; Riddell, James; Xiao, Robert

doi:10.1109/tvcg.2023.3320255

Search citation statements

Order By: Relevance

Paper Sections

Select...

Citation Types

Supporting

Mentioning

Contrasting

Year Published

2023

2024

Publication Types

Select...

Other2

Article2

Relationship

Self Cite0

Independent4

Authors

Journals

Cited by 4 publications

References 46 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

A Simulation of Energy Optimized Distributed Video Processing on 28 GHz Network

Techasarntikul,

Shimonishi,

Murata

2024

2024 27th Conference on Innovation in Clouds, Internet and Networks (ICIN)

View full text Add to dashboard Cite

A Simulation of Energy Optimized Distributed Video Processing on 28 GHz Network

Techasarntikul,

Shimonishi,

Murata

2024

2024 27th Conference on Innovation in Clouds, Internet and Networks (ICIN)

View full text Add to dashboard Cite

SurfShare

Huang,

Xiao

2023

Proc. ACM Interact. Mob. Wearable Ubiquitous Technol.

View full text Add to dashboard Cite

Shared Mixed Reality experiences allow two co-located users to collaborate on both physical and digital tasks with familiar social protocols. However, extending the same to remote collaboration is limited by cumbersome setups for aligning distinct physical environments and the lack of access to remote physical artifacts. We present SurfShare, a general-purpose symmetric remote collaboration system with mixed-reality head-mounted displays (HMDs). Our system shares a spatially consistent physical-virtual workspace between two remote users, anchored on a physical plane in each environment (e.g., a desk or wall). The video feed of each user's physical surface is overlaid virtually on the other side, creating a shared view of the physical space. We integrate the physical and virtual workspace through virtual replication. Users can transmute physical objects to the virtual space as virtual replicas. Our system is lightweight, implemented using only the capabilities of the headset, without requiring any modifications to the environment (e.g. cameras or motion tracking hardware). We discuss the design, implementation, and interaction capabilities of our prototype, and demonstrate the utility of SurfShare through four example applications. In a user experiment with a comprehensive prototyping task, we found that SurfShare provides a physical-virtual workspace that supports low-fi prototyping with flexible proxemics and fluid collaboration dynamics.

show abstract