In this paper, we conduct a survey of the literature about reinforcement learning (RL)-based medium access control (MAC) protocols. As the scale of the wireless ad hoc network (WANET) increases, traditional MAC solutions are becoming obsolete. Dynamic topology, resource allocation, interference management, limited bandwidth and energy constraint are crucial problems needing resolution for designing modern WANET architectures. In order for future MAC protocols to overcome the current limitations in frequently changing WANETs, more intelligence need to be deployed to maintain efficient communications. After introducing some classic RL schemes, we investigate the existing state-of-the-art MAC protocols and related solutions for WANETs according to the MAC reference model and discuss how each proposed protocol works and the challenging issues on the related MAC model components. Finally, this paper discusses future research directions on how RL can be used to enable MAC protocols for high performance.
Along with the fast development of the marine economy and ever-increasing human activities, handy and reliable marine networking services are increasingly required in recent years. The ocean faces challenges to support cost-effective communication due to its special environments. Opportunistic networks with easy deployment and self-curing capability are expected to play an important role to adapt to such dynamic networking environments. In the literature, routing schemes for opportunistic networks mainly exploit node mobility and local relaying technologies. They did not take into account the impact of node behaviors on encountering opportunities and in case of no further relaying, network performance would be greatly degraded. To solve the problem, we propose an efficient routing scheme based on node attributes for opportunistic networks. We first construct delivery competency to predict the further relay nodes. Then a forwarding willingness mechanism is introduced to evaluate the relaying probability combining device capacity and movement behaviors of nodes. Finally, the utility metric is used to make decisions on message forwarding. The results show that the proposed scheme improves network performance in terms of delivery ratio, average latency, and overhead ratio as compared to other schemes.
Nautical wireless ad hoc networks are becoming increasingly popular in oceans due to their easy deployment and self-curing capability. They may alternate frequently between connected mobile ad hoc networks and partitioned opportunistic networks due to mobility in large spaces. Traditional mobile ad hoc network routing is used to find the shortest route for connected networks. However, for opportunistic networks, routing schemes with a broadcast nature mainly exploit the reduction in message duplication and the local relaying technologies described in the literature, which may lead to unnecessary resource waste and low packet delivery ratios. To solve the problem, we propose an efficient opportunistic routing scheme based on prediction for nautical wireless ad hoc networks. The scheme first develops an effective candidate intermediate region to recognize the unavailability of some apparently qualified intermediate nodes, and then takes into account the packet reception ratio between nodes and relay advancement prediction, to improve packet delivery. The proposed scheme achieves performance improvements regarding packet loss ratio and throughput with a tolerable latency increase, compared to other schemes.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.