Radio resources in vehicle-to-vehicle (V2V) communication can be scheduled either by a centralized scheduler residing in the network (e.g., a base station in case of cellular systems) or a distributed scheduler, where the resources are autonomously selected by the vehicles. The former approach yields a considerably higher resource utilization in case the network coverage is uninterrupted. However, in case of intermittent or out-of-coverage, due to not having input from centralized scheduler, vehicles need to revert to distributed scheduling.Motivated by recent advances in reinforcement learning (RL), we investigate whether a centralized learning scheduler can be taught to efficiently pre-assign the resources to vehicles for outof-coverage V2V communication. Specifically, we use the actorcritic RL algorithm to train the centralized scheduler to provide non-interfering resources to vehicles before they enter the outof-coverage area.Our initial results show that a RL-based scheduler can achieve performance as good as or better than the state-of-art distributed scheduler, often outperforming it. Furthermore, the learning process completes within a reasonable time (ranging from a few hundred to a few thousand epochs), thus making the RL-based scheduler a promising solution for V2V communications with intermittent network coverage.
We explore a new approach to radio resource allocation for vehicle-to-vehicle (V2V) communications in case of outof-coverage areas that are delimited by network infrastructure. By collecting and predicting information such as vehicle velocity, density and message traffic, the network infrastructure ensures reliability of the V2V services. We propose reserving required amount of resources for services that cannot be pre-scheduled (e.g., emergency braking, crash notifications, etc.), and scheduling those services that can be pre-scheduled (e.g., platooning). We analyze the resource reservation as a function of target reliability under varying vehicle densities and sizes of out-of-coverage area. For pre-scheduled services, we explore how variations in the vehicle velocities and predictions affect successful transmissions.The results indicate that increase in required reliability does not penalize the system prohibitively. On the other hand, speed prediction errors decrease the transmission success rate considerably, thus calling for a more flexible scheduler design.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.