Accurate detection of sea-surface objects is vital for the safe navigation of autonomous ships. With the continuous development of artificial intelligence, electro-optical (EO) sensors such as video cameras are used to supplement marine radar to improve the detection of objects that produce weak radar signals and small sizes. In this study, we propose an enhanced convolutional neural network (CNN) named VarifocalNet* that improves object detection in harsh maritime environments. Specifically, the feature representation and learning ability of the VarifocalNet model are improved by using a deformable convolution module, redesigning the loss function, introducing a soft non-maximum suppression algorithm, and incorporating multi-scale prediction methods. These strategies improve the accuracy and reliability of our CNN-based detection results under complex sea conditions, such as in turbulent waves, sea fog, and water reflection. Experimental results under different maritime conditions show that our method significantly outperforms similar methods (such as SSD, YOLOv3, RetinaNet, Faster R-CNN, Cascade R-CNN) in terms of the detection accuracy and robustness for small objects. The maritime obstacle detection results were obtained under harsh imaging conditions to demonstrate the performance of our network model.
Reducing the carbon emissions of ships and increasing the utilization of marine renewable energy are the important ways to achieve the goal of carbon neutrality in ocean engineering. Establishing an accurate mathematical model is the foundation of simulating the motion of marine vehicles and structures, and it is the basis of operation energy efficiency optimization and prediction of power generation. System identification from observed input–output data is a practical and powerful method. However, for modeling objects with different characteristics and known information, a single modeling framework can hardly meet the requirements of model establishment. Moreover, there are some challenges in system identification, such as parameter drift and overfitting. In this work, three robust methods are proposed for generating ocean hydrodynamic models based on Bayesian regression. Two Bayesian techniques, semi-conjugate linear regression and noisy input Gaussian process regression are used for parametric and nonparametric gray-box modeling and black-box modeling. The experimental free-running tests of the KRISO very large crude oil carrier (KVLCC2) ship model and a multi-freedom wave energy converter (WEC) are used to validate the proposed Bayesian models. The results demonstrate that the proposed schemes for system identification of the ship and WEC have good generalization ability and robustness. Finally, the developed modeling methods are evaluated considering the aspects required conditions, operating characteristics, and prediction accuracy.
A complete virtual test environment is a powerful tool for Autonomous Surface Vessels (ASVs) research, and the simulation of ship motion and shipborne sensors is one of the prerequisites for constructing such an environment. This paper proposed a universal simulation framework of shipborne inertial sensors. A ship motion model considering environmental disturbances is proposed to simulate the six-degrees-of-freedom motion of ships. The discrete form of the inertial sensor stochastic error model is derived. The inertial measurement data are simulated by adding artificial errors to a simulated motion status. In addition, the ship motion simulation, inertial measurement simulation, and environment simulation nodes are implemented based on the computational graph architecture of the Robot Operating System (ROS). The benefit from the versatility of the ROS messages, the format of simulated inertial measurement is exactly the same as that of real sensors, which provides a research basis for the fusion perception algorithm based on visual–inertial and laser–inertial sensors in the research field of ASVs.
scite is a Brooklyn-based organization that helps researchers better discover and understand research articles through Smart Citations–citations that display the context of the citation and describe whether the article provides supporting or contrasting evidence. scite is used by students and researchers from around the world and is funded in part by the National Science Foundation and the National Institute on Drug Abuse of the National Institutes of Health.