SeeCoast port surveillance

Abstract

SeeCoast extends the US Coast Guard Port Security and Monitoring system by adding capabilities to detect, classify, and track vessels using electro-optic and infrared cameras, and also uses learned normalcy models of vessel activities in order to generate alert cues for the watch-standers when anomalous behaviors occur. SeeCoast fuses the video data with radar detections and Automatic Identification System (AIS) transponder data in order to generate composite fused tracks for vessels approaching the port, as well as for vessels already in the port. Then, SeeCoast applies rule-based and learning-based pattern recognition algorithms to alert the watch-standers to unsafe, illegal, threatening, and other anomalous vessel activities. The prototype SeeCoast system has been deployed to Coast Guard sites in Virginia. This paper provides an overview of the system and outlines the lessons learned to date in applying data fusion and automated pattern recognition technology to the port security domain.Keywords: Port security, video surveillance, track fusion, alerts, anomaly detection, homeland security GOALS AND ARCHITECTUREAutomated scene understanding is a common issue throughout the Department of Homeland Security, including Coast Guard, Border Patrol, Transportation Security, and Infrastructure Protection. Numerous sensors have been deployed for these Agencies, engendering watch-stander manning as a growing problem. The goal of automated scene understanding is to reduce operator workload while maintaining effectiveness and improving detection of anomalous behaviors.SeeCoast builds upon the USCG Hawkeye system, which uses a combination of surface surveillance radar and Automatic Identification System (AIS) beacons to track vessels and generate zone-incursion alerts. Hawkeye also includes manually-controlled and radar-slaved video cameras, an integrated command center, and a web-based information client. Hawkeye has been deployed to more than six operational US Coast Guard (USCG) Sector Command Centers. It allows watch-standers to surveil all vessel arrivals, departures, and transits within a port-centered area of interest.Currently, watch-standers attempt to detect and assess possible anomalous behaviors using a large number of video cameras, radars, and AIS track data. SeeCoast has two goals: to increase the effectiveness of the watch-standers, and to increase their efficiency in surveillance operations. SeeCoast increases watch-stander effectiveness by adding capabilities to process video and infrared camera streams to detect, classify (small, medium, large vessel size), and track vessels; to fuse video tracks with radar & AIS tracks; to maintain seamless 24/7 vigilance on the track scene; to provide consistent alerting using established rules and learned normalcy models; and to free the surveillance system operators to assess behaviors rather than spending their time detecting behaviors. SeeCoast increases the efficiency of maritime surveillance operations by simultaneously examining data and tracks from many...

Vessel Pattern Knowledge Discovery from AIS Data: A Framework for Anomaly Detection and Route Prediction

“…In [17], a probabilistic model to track human behavior over time is presented. The papers [18][19][20][21] specifically deal with maritime applications, although using image processing techniques. Reference [12] presented an extensive model to statistically learn motion patterns without any prior knowledge in traffic scenes where the traffic flows are constrained to stay in specific areas.…”

Multispectral Systems of Imaging Scenery in Critical Infrastructure Protection, Threat Identification and Recognition

“…In order to ensure complete safety of objects like seaports, and to ensure protection against all threats mentioned above, it is necessary to connect under and above water threat detection systems. Such systems should include radar--camera units (allowing for identication and tracking of port personnel, vehicles and vessels [3]) and active and passive monitoring systems of underwater activities such as sonar and magnetic barriers [4,5]. As a part of a research lead in the Military University of Technology, demonstrator of a seaport security system based on these assumptions was developed.…”

Detection and tracking of moving objects in a maritime environment using level set with shape priors

“…Colour segmentation is treated as a graph-partitioning problem, and combining it with background subtracted output results in enhanced performance. There have also been many other attempts to build maritime surveillance systems; some example could be found in [27,28].…”