Semantic-Aware Sensing Information Transmission for Metaverse: A Contest Theoretic Approach

Wang, Jiacheng; Du, Hongyang; Tian, Zengshan; Niyato, Dusit; Kang, Jiawen

doi:10.1109/twc.2022.3232565

Cited by 35 publications

(16 citation statements)

References 40 publications

Supporting

Mentioning

Contrasting

Order By: Relevance

“…The experimental platform utilized for executing the proposed resource allocation is built on a generic Ubuntu 20.04 system, featuring an AMD Ryzen Threadripper PRO 3975WX 32-Core CPU and an NVIDIA RTX A5000 GPU. The approximate semantic entropy, average transmitted symbols, channel gain and transmit power between the AIGC and rendering modules, as well as channel gain and transmit power between edge servers and devices, are randomly sampled from uniform distributions (1, 2), (0, 0.8), (0, 1), (3,5), (0, 1), and (3,5), respectively. The additive Gaussian noise at the AIGC and rendering modules is randomly sampled from normal distributions (0, 1) and (0, 1), respectively.…”

Section: Simulation Resultsmentioning

confidence: 99%

“…1) Resource Underutilization: Current resource allocation solutions tend to focus on individual modules, rather than considering the integrated ISGC as a whole. For instance, J. Wang et al [5] proposed using contest theory to incentive users in the semantic module to contribute more valuable information. However, this approach may lead to the overuse of certain resources in one module while leaving others idle, resulting in inefficient resource allocation and decreased performance.…”

Section: B Major Issues In Separated Functionalitiesmentioning

confidence: 99%

See 1 more Smart Citation

A Unified Blockchain-Semantic Framework for Wireless Edge Intelligence Enabled Web 3.0

Lin¹,

Gao²,

Du³

et al. 2024

IEEE Wireless Commun.

View full text Add to dashboard Cite

As the Metaverse continues to grow, the need for efficient communication and intelligent content generation becomes increasingly important. Semantic communication focuses on conveying meaning and understanding from user inputs, while AI-Generated Content utilizes artificial intelligence to create digital content and experiences. Integrated Semantic Communication and AI-Generated Content (ISGC) has attracted a lot of attentions recently, which transfers semantic information from user inputs, generates digital content, and renders graphics for Metaverse. In this paper, we introduce a unified framework that captures ISGC's two primary benefits: integration gain for optimized resource allocation and coordination gain for goaloriented high-quality content generation to improve immersion from both communication and content perspectives. We also classify existing ISGC solutions, analyze the major components of ISGC, and present several use cases. We then construct a case study based on the diffusion model to identify an optimal resource allocation strategy for performing semantic extraction, content generation, and graphic rendering in the Metaverse. Finally, we discuss several open research issues, encouraging further exploring the potential of ISGC and its related applications in the Metaverse.

show abstract

Section: Simulation Resultsmentioning

confidence: 99%

Section: B Major Issues In Separated Functionalitiesmentioning

confidence: 99%

A Unified Blockchain-Semantic Framework for Wireless Edge Intelligence Enabled Web 3.0

Lin¹,

Gao²,

Du³

et al. 2024

IEEE Wireless Commun.

View full text Add to dashboard Cite

show abstract

“…Calibrating wireless networks for mobile users accessing the Metaverse is an emerging research topic. Recently, a number of papers on the topic have appeared in different venues: [11] in JSAC coauthored by the first author of the current paper, [12] in JSAC, [13] in TWC, [14,15] in TVT, and a survey paper [1] in COMST, where the meanings of the abbreviations can be found in the references.…”

Section: Metaverse Over Wireless Networkmentioning

confidence: 99%

“…Among the technical papers above, [11,12,15] adopt reinforcement learning to optimize wireless performance for the Metaverse, while [13,14] utilize economic theories to incentivize users for improving the usage of semantic-aware sensing and coded distributed computing for wireless Metaverse. The current paper's co-authors have recently optimized wireless federated learning in [16] for the Metaverse via alternating optimization, which achieves neither local nor global optimum.…”

Section: Metaverse Over Wireless Networkmentioning

confidence: 99%

Optimizing Utility-Energy Efficiency for the Metaverse over Wireless Networks under Physical Layer Security

Zhao¹,

Zhou²,

Li³

et al. 2023

Preprint

View full text Add to dashboard Cite

The Metaverse, an emerging digital space, is expected to offer various services mirroring the real world. Wireless communications for mobile Metaverse users should be tailored to meet the following user characteristics: 1) emphasizing application-specific perceptual utility instead of simply the transmission rate, 2) concerned with energy efficiency due to the limited device battery and energy intensiveness of some applications, and 3) caring about security as the applications may involve sensitive personal data. To this end, this paper incorporates application-specific utility, energy efficiency, and physical-layer security (PLS) into the studied optimization in a wireless network for the Metaverse. Specifically, after introducing utility-energy efficiency (UEE) to represent each Metaverse user's application-specific objective under PLS, we formulate an optimization to maximize the network's weighted sum-UEE by deciding users' transmission powers and communication bandwidths. The formulated problem belongs to the sum-of-ratios optimization, for which prior studies have demonstrated its difficulty. Nevertheless, our proposed algorithm 1) obtains the global optimum for the weighted sum-UEE optimization, via a transform to parametric convex optimization problems, 2) applies to any utility function which is concave, increasing, and twice differentiable, and 3) achieves a linear time complexity in the number of users (the optimal complexity in the order sense). Simulations confirm the superiority of our algorithm over other approaches. We explain that our technique for solving the sum-of-ratios optimization is applicable to other optimization problems in wireless networks and mobile computing.

show abstract

“…However, the collected data could still burden the network. For example, the authors in [5] state that a pair of sensing devices can generate 3.072 megabytes of data per second, which challenges conventional communication systems. Fortunately, semantic communication [6] is introduced to filter out irrelevant information from edge devices to reduce information redundancy of VSPs by extracting semantic data from raw data and expressing desired meanings (For D2).…”

mentioning

confidence: 99%

Blockchain-Aided Secure Semantic Communication for AI-Generated Content in Metaverse

Lin

Niyato

et al. 2023

IEEE Open J. Comput. Soc.

Self Cite

View full text Add to dashboard Cite

The construction of virtual transportation networks requires massive data to be transmitted from edge devices to Virtual Service Providers (VSP) to facilitate circulations between the physical and virtual domains in Metaverse. Leveraging semantic communication for reducing information redundancy, VSPs can receive semantic data from edge devices to provide varied services through advanced techniques, e.g., AI-Generated Content (AIGC), for users to explore digital worlds. But the use of semantic communication raises a security issue because attackers could send malicious semantic data with similar semantic information but different desired content to break Metaverse services and cause wrong output of AIGC. Therefore, in this paper, we first propose a blockchain-aided semantic communication framework for AIGC services in virtual transportation networks to facilitate interactions of the physical and virtual domains among VSPs and edge devices. We illustrate a training-based targeted semantic attack scheme to generate adversarial semantic data by various loss functions. We also design a semantic defense scheme that uses the blockchain and zero-knowledge proofs to tell the difference between the semantic similarities of adversarial and authentic semantic data and to check the authenticity of semantic data transformations. Simulation results show that the proposed defense method can reduce the semantic similarity of the adversarial semantic data and the authentic ones by up to 30% compared with the attack scheme.

show abstract

Semantic-Aware Sensing Information Transmission for Metaverse: A Contest Theoretic Approach

Cited by 35 publications

References 40 publications

A Unified Blockchain-Semantic Framework for Wireless Edge Intelligence Enabled Web 3.0

A Unified Blockchain-Semantic Framework for Wireless Edge Intelligence Enabled Web 3.0

Optimizing Utility-Energy Efficiency for the Metaverse over Wireless Networks under Physical Layer Security

Blockchain-Aided Secure Semantic Communication for AI-Generated Content in Metaverse

Contact Info

Product

Resources

About