Surveillance is an important task during naval operations. This task can be performed with a combination of different sensors, including camera systems and radar. To obtain a consistent operational picture of possible threats in the vicinity of a ship, the information from the different sensors need to be combined into one overview image, in which all information related to one object is assigned to this object. In this paper, we present a new dataset for maritime surveillance applications and show two examples of combining information from different sensors. We have recorded data with several camera systems, automatic identification system (AIS) and radar in the Rotterdam Harbor. From all sensors we can obtain tracking information from the different objects. We present a method to associate the tracks and describe how snippets of the ships in the cameras can be used to enrich the information of the objects. Next to that, we show the combined information from AIS and imagery.

© (12 September 2021) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.

Judith Dijk, Sebastiaan P. van den Broek, Richard J. M. den Hollander, Jan Baan, Johan-Martijn ten Hove, and Dirk Oorbeek, "Multi-sensor information extraction and combination in a large harbor surveillance experiment," Proc. SPIE 11870, Artificial Intelligence and Machine Learning in Defense Applications III, 1187007 (Presented at SPIE Security + Defence: 12 September 2021; Published: 12 September 2021); https://doi.org/10.1117/12.2604163.