This paper presents an automatic collision avoidance algorithm for ships using a deep reinforcement learning (DRL) in continuous action spaces. Obstacle zone by target (OZT) is used to compute an area where a collision will happen in the future based on dynamic information of ships. Agents of DRL detects the approach of multiple ships using a virtual sensor called the grid sensor. Agents learned collision avoidance maneuvering through Imazu problem, which is a scenario set of ship encounter situations. In this study, we propose a new approach for collision avoidance with a longer safe passing distance using DRL. We develop a novel method named inside OZT that expands OZT to improve the consistency of learning. We redesign the network using the long short-term memory (LSTM) cell and carried out training in continuous action spaces to train a model with longer safe distance than the previous study. The bow cross range in collision detection proposed in this paper is effective to COLREGs-compliant collision avoidance. The trained model has passed all scenarios of Imazu problem. The model is also validated by a test scenario which includes more ships than each scenario of Imazu problem.
: Scheduled liner service is a proper system for mass transportation and it is employed by wide range of transportation modes, such as railway, airline, maritime container shipping and bus. To get more customers, providers of the liner services are required to organize effective routes and networks of the service incorporating the characteristic of the passenger's route selection. This paper tackles to the problem of generating Public Transit Network as one of scheduled liner service. The method generating PTN is based on Multi Agent System that incorporates the characteristic of passenger's route selection. And it is also reported that the developed method successfully output best solution for a benchmark problem.
The establishment of maritime safety and security is an important concern. Ship position prediction for maritime situational awareness (MSA), as a critical aspect of maritime safety and security, requires a longer time interval than collision avoidance and maritime traffic monitoring. However, previous studies focused mainly on shorter time-interval predictions ranging from 30 min to 10 h. A longer time-interval ship position prediction is required not only for MSA, but also for efficient allocation of ships by shipping companies in accordance with global freight demand. This study used an end-to-end tracking method that inputs the previous position of a vessel to a trained deep learning model to predict its next position with an average 24-h interval. An AIS dataset with a long-time-interval distribution in a nine-year timespan for capesize bulk carriers worldwide was used. In the first experiment, a deep learning model of the Indian Ocean was examined. Subsequently, the model performance was compared for six different oceans and six primary maritime chokepoints to investigate the influence of each area. In the third experiment, a sample location within the Malacca Strait area was selected, and the number of ships was counted daily. The results indicate that the ship position can be predicted accurately with an average time interval of 24 h using deep learning systems with AIS data.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.