Dynamic spectrum access (DSA) is regarded as an effective and efficient technology to share radio spectrum among different networks. As a secondary user (SU), a DSA device will face two critical problems: avoiding causing harmful interference to primary users (PUs), and conducting effective interference coordination with other secondary users. These two problems become even more challenging for a distributed DSA network where there is no centralized controllers for SUs. In this paper, we investigate communication strategies of a distributive DSA network under the presence of spectrum sensing errors. To be specific, we apply the powerful machine learning tool, deep reinforcement learning (DRL), for SUs to learn "appropriate" spectrum access strategies in a distributed fashion assuming NO knowledge of the underlying system statistics. Furthermore, a special type of recurrent neural network (RNN), called the reservoir computing (RC), is utilized to realize DRL by taking advantage of the underlying temporal correlation of the DSA network. Using the introduced machine learning-based strategy, SUs could make spectrum access decisions distributedly relying only on their own current and past spectrum sensing outcomes. Through extensive experiments, our results suggest that the RCbased spectrum access strategy can help the SU to significantly reduce the chances of collision with PUs and other SUs. We also show that our scheme outperforms the myopic method which assumes the knowledge of system statistics, and converges faster than the Q-learning method when the number of channels is large.Index Terms-Dynamic spectrum access (DSA), deep reinforcement learning (DRL), deep Q-network (DQN), reservoir computing (RC), echo state network (ESN), and resource allocation.

No abstract

Reservoir computing (RC) is a special neural network which consists of a fixed high dimensional feature mapping and trained readout weights. In this paper, we consider a new RC structure for MIMO-OFDM symbol detection, namely windowed echo state network (WESN). It is introduced by adding buffers in input layers which brings an enhanced short-term memory (STM) of the underlying neural network through our theoretical proof. A unified training framework is developed for the WESN MIMO-OFDM symbol detector using both comb and scattered pilot patterns, where the utilized pilots are compatible with the structure adopted in 3GPP LTE/LTE-Advanced systems. Complexity analysis reveals the advantages of the WESN based symbol detector over the state-of-the-art symbol detectors such as the linear the minimum mean square error (LMMSE) detection and the sphere decoder when the system is employed with a large number of OFDM sub-carriers. Numerical evaluations corroborate that the improvement of the STM introduced by the WESN can significantly improve the symbol detection performance as well as effectively mitigate model mismatch effects as opposed to existing methods.

No abstract

Device-to-device (D2D) communications provide efficient ways to increase spectrum utilization ratio with reduced power consumption for proximity wireless applications. In this paper, we investigate resource allocation strategies for D2D communications underlaying cellular networks. To be specific, we study the centralized resource allocation algorithm for controlling transmit powers of the underlying D2D pairs in order to maximize the weighted sum-rate while guaranteeing the quality of service (QoS) requirements for both D2D pairs and cellular users (CUs). A novel DC (difference of convex function) programming-based method, called alternative DC (ADC) programming, is introduced to effectively solve this complicated resource allocation problem. Through updating each D2D pair's power alternatively, the QoS requirement for each D2D pair can be solvable and incorporated systematically to the introduced ADC programming framework. The simulation results show that the introduced ADC programming achieves the highest weighted sum-rate compared to the state-of-the-art methods while ensuring that the QoS of each D2D pair and CU are satisfied.