A distributed framework for extracting maritime traffic patterns

Ioannis Kontopoulos, Iraklis Varlamis and Konstantinos Tserpes

INTERNATIONAL JOURNAL OF GEOGRAPHICAL INFORMATION SCIENCE, 2020

Abstract

All the modern surveillance systems take advantage of the Automatic Identification System (AIS), a compulsory tracking system for many types of vessels. Ships that carry AIS transponders on board transmit their position and status in order to alert nearby vessels and ground stations, but this information can well be used to identify events of interest and support decision making. The detection of anomalies (i.e. unexpected sailing behavior) in vessels’ trajectories is such an event, which is of utmost importance. Approaches for detecting such anomalies vary from extracting normality models to searching for individual cases, such as AIS switch-off or collision avoidance maneuvers. The current research work follows the former method; it employs sparse historic AIS data and polynomial interpolation in order to extract shipping lanes. It modifies the DB-Scan clustering algorithm in order to achieve more coherent trajectory clusters, which are then composed to create the shipping lanes. The proposed approach implements distributed processing on Apache Spark in order to improve processing speed and scalability and is evaluated using real-world AIS data collected from terrestrial AIS receivers. The evaluation shows that the biggest part (i.e. more than 90%) of any future vessel trajectory falls within the extracted shipping lanes.

This work was supported by the MASTER and SmartShip Projects through the European Union’s Horizon 2020 research and innovation programme under the Marie-Slodowska Curie grant agreement no 777695 and 823916 respectively. The work reflects only the authors’ view and that the EU Agency is not responsible for any use that may be made of the information it contains.

OUR WORLDWIDE PARTNERS
Previous
Next
December 3, 2023
Big Data
Machine Learning
Navigating through dense waters: a toolbox for creating maritime density maps
Read more
December 3, 2023
Big Data
Data Driven Digital Twins for the Maritime Domain
Read more
December 4, 2023
Satellite Imagery
Vessel Traffic Density Maps Based on Vessel Detection in Satellite Imagery
Read more
December 4, 2023
Big Data
COVID-19 impact on global maritime mobility
Read more
December 4, 2023
Machine Learning
A computer vision approach for trajectory classification
Read more
December 4, 2023
Big Data
A Big Data framework for Modelling and Simulating high-resolution hydrodynamic models in sea harbours
Read more
December 4, 2023
No items found.
Modelling and simulating vessel emissions in real time based on terrestrial AIS data
Read more
December 4, 2023
No items found.
Vessel detection using image processing and Neural Networks
Read more
December 10, 2023
Big Data
MongoDB Vs PostgreSQL: A comparative study on performance aspects
Read more
December 10, 2023
Machine Learning
Big Data
A distributed framework for extracting maritime traffic patterns
Read more
December 10, 2023
Artificial Intelligence
Satellite Imagery
Automatic Maritime Object Detection Using Satellite imagery
Read more
December 10, 2023
Satellite Imagery
Vessel detection using image processing and Neural Networks
Read more
December 10, 2023
Stream Processing
Real-time maritime anomaly detection: detecting intentional AIS switch-off
Read more
December 10, 2023
Machine Learning
Stream Processing
Industry Paper: Classification of vessel activity in streaming data
Read more
December 10, 2023
Data Fusion
Machine Learning
Automatic Fusion of Satellite Imagery and AIS data for Vessel Detection
Read more
December 10, 2023
Big Data
Machine Learning
A distributed spatial method for modeling maritime routes
Read more
December 10, 2023
Big Data
Machine Learning
A data driven approach to maritime anomaly detection
Read more
December 10, 2023
Artificial Intelligence
Monitoring Marine Protected Areas using Data Fusion and AI Techniques
Read more
December 10, 2023
Big Data
Machine Learning
Anomaly Detection white paper
Read more
December 10, 2023
Big Data
Machine Learning
Stream Processing
A distributed lightning fast maritime anomaly detection service
Read more
December 15, 2023
Autonomous Vessels
Data Fusion
Preliminary Inter-comparison of AIS Data and Optimal Ship Tracks
Read more
December 15, 2023
Big Data
Machine Learning
A comparison of supervised learning schemes for the detection of search and rescue (SAR) vessel patterns
Read more
December 15, 2023
Big Data
BigDataOcean Project: Early Anomaly Detection from Big Maritime Vessel Traffic Data
Read more
December 15, 2023
Machine Learning
Vessel Profile Indicators using Fuzzy Logic Reasoning and AIS
Read more
December 15, 2023
Artificial Intelligence
Autonomous Vessels
Real Time Autonomous Maritime Navigation using Dynamic Visibility Graphs
Read more
December 15, 2023
Big Data
Stream Processing
Countering Real-Time Stream Poisoning: An Architecture for Detecting Vessel Spoofing in Streams of AIS Data
Read more
December 15, 2023
Big Data
Machine Learning
Mining Vessel Trajectory Data for Patterns of Search and Rescue
Read more
January 10, 2024
No items found.
SELECT – Artificial Intelligence in Inland Navigation
Read more
January 10, 2024
No items found.
CADMUSS – an innovative project to improve maritime safety
Read more
January 10, 2024
No items found.
Determining the bilge water waste risk and management in the Gulf of Antalya by the Monte Carlo method
Read more
January 10, 2024
No items found.
FleetMon Supports the Development of Environmental Impact Assessment on the Brazilian Coast
Read more
January 10, 2024
Emissions
Scrapping Probabilities and Committed CO2 Emissions of the International Ship Fleet
Read more
January 10, 2024
Emissions
The CO2 reduction potential of shore-side electricity in Europe
Read more
January 10, 2024
Emissions
Estimation of worldwide ship emissions using AIS signals
Read more
January 10, 2024
Machine Learning
Routing Network
Scalable In-Database Machine Learning for the Prediction of Port-to-Port Routes
Read more
January 10, 2024
Emissions
Green shipping: using AIS data to assess global emissions
Read more
January 10, 2024
Routing Network
How a real-time-based sea traffic forecast helps to organize and optimize the flow of maritime goods
Read more
January 10, 2024
Routing Network
Generating a node in an AIS-based routing graph for improved Estimated Time of Arrival. (Big) Data challenge: using AIS for generating a routing graph
Read more
January 10, 2024
No items found.
Composition, spatial distribution and sources of macro-marine litter on the Gulf of Alicante seafloor (Spanish Mediterranean)
Read more
January 10, 2024
No items found.
Climate change, non-indigenous species and shipping: assessing the risk of species introduction to a high-Arctic archipelago
Read more
January 15, 2024
No items found.
The Big Picture: An Improved Method for Mapping Shipping Activities
Read more
April 10, 2024
No items found.
GMSA: A Digital Twin Application for Maritime Route and Event Forecasting
Read more
April 11, 2024
No items found.
A Scalable System for Maritime Route and Event Forecasting
Read more
April 11, 2024
No items found.
Patterns of Life : Global Inventory for maritime mobility patterns
Read more

Require AIS data for your project?

Please reach out to us to discuss which Kpler offering will support your research project or academic study in the best possible and efficient way.