Towards More Efficient EfficientDets and Real-Time Marine Debris Detection

Abstract

Colab CPU, a Colab GPU (which is either a Tesla P100 or 230 a Tesla T4), an Nvidia Jetson Xavier and a Nvidia Jetson 231 Nano: the server GPU is the fastest followed by the Xavier, 232 the Nano and the server CPU. The same ranking occurs for 233 the scaling ratio: D3(1-5) is 3.2 times slower than D0(1-234 5) with the server GPU, 5.3 times slower with the Xavier, 235 6.3 times slower with the Nano and 7.9 times slower with 236 the server CPU. Therefore, a more powerful GPU has a 237 double benefit: smaller runtimes and smaller scaling ratios; 238 however, the full-fledged GPUs used in large clusters cannot 239 be installed on underwater robots due to energy, space and 240 weight constraints. 241 B. On Marine Debris Datasets 242 Subsequently, we trained our improved EfficientDets on 243 the first 1200 samples of the Trash-ICRA19 [11], which is 244 a publicly available annotated dataset for object detection 245 targeting three classes: "bio" for biological items, "plastic" 246 for plastic items and "rov" for remotely operated vehicles. 247 The results are in Table VI, where 35 epochs have been 248 chosen for demonstration purposes; when training a model 249 for deployment on an AUV, the number of epochs should 250 be increased in order to reach the learning saturation. With 251 35 epochs, we reached 47.4% AP with D0 and 49.6% AP 252 289 4; most of the samples of WPBB are taken at more than 290 a meter of distance from the object, hence most of the 291 pixels are background; some samples of WPBB have low 292 resolution because captured while the drone was steering. 293 All these factors make the WPBB dataset both challenging 294 and realistic. Examples of detections are shown in Fig. 4 295 with different values of confidence threshold τ , which is an 296 hyperparameter meaning that detections with a confidence 297 lower than τ are ignored: the plastic bag is detected by all 298 the four detectors with high confidence, but its detection is 299 relatively easy since it is well visible; in contrast, one of the 300 two floating bottles at the top is detected only by D0 with 301 just a 43% confidence. 302 C. Evaluations on Simulator 303 Given that underwater data were expensive to collect, 304 we further carried out reproducible simulation evaluations 305 using the proposed D2(1-5). The simulation in Unity 3D 306 engine provided realistic visual effects and labor-free ground 307 truth labeling. The general setup is similar to our previ-308 ous work [27]. The system included two simulators: Unity 309 (virtual reality (VR) side) and Gazebo (robot side). In the 310 current study, the VR side was involved to transfer real-311 time realistic images rendered by the Unity 3D engine to 312 the object detector. Both Unity and Gazebo included its own 313 virtual vehicle, i.e., a boat equipped with an underwater 314 camera. The robot side was designed to switch either via 315 the Gazebo simulation or a real robot. The robot side 316 included an object detection module running the D2(1-5) 317 model, a navigation and control module pe...

Thermodynamical Material Networks for Modeling, Planning, and Control of Circular Material Flows

“…Vision systems along with public datasets have been proposed for litter recognition in water bodies to address the increasing waste accumulations [19]- [21]. Construction and demolition waste sorting was performed by Wang et al [22], while the system of Bai et al [23] enabled their robot to detect garbage on grass before picking it.…”

YOLOv8-C2f-Faster-EMA: An Improved Underwater Trash Detection Model Based on YOLOv8

“…These diminutive fragments harbor the potential to permeate through trophic levels, being ingested or inhaled by a diverse array of species, including humans, thereby insidiously infiltrating the food web. The ramifications of this phenomenon extend beyond the immediate ecological disturbances, catalyzing broader spectrums of water pollution and engendering a cascade of environmental and health-related adversities [ 3 ].…”