HELM
The Challenge
Name:
Graphical User Interface for UAS
Domain:
Cargo Halls, Ballast Water Tanks, and Computer Vision
Challenge proposer:
Objectives:
- Design, implement, and test a mission execution engine and graphical user interface for UAS-based vessel inspection.
- Connect mission-planning tools, cloud services, digital models, and drones in one workflow.
- Turn high-level inspection plans into commands that different UAS platforms can follow.
- Allow operators to monitor missions in real time and intervene when needed.
- Record mission progress, system status, results, and logs for later review and analysis.
- Support the different UAS platforms used in AUTOASSESS.
- Improve safety, security, traceability, and compliance with relevant operational requirements.
The Solution
Name:
HELM – Human-centred Execution and Live Monitoring for UAS vessel inspection
HELM will develop a framework for executing and monitoring AUTOASSESS UAS vessel-inspection missions during the live operational phase. It will connect AUTOASSESS cloud infrastructure, UAS platforms, and human operators through two main components: a Mission Execution Engine that interprets mission plans, translates them into platform commands, manages mission state, telemetry, fail-safes, logs, outputs, and variable connectivity; and a Graphical User Interface that provides live monitoring, situational awareness, alerts, mission data, and human-in-the-loop controls such as start, pause, resume, abort, return-home, and task repetition. Co-designed with AUTOASSESS partners and operators, HELM will define component interfaces and data exchanges, support mission execution throughout its lifecycle, and be validated in operational pilot conditions. The project aims to improve coordination, consistency, safety, traceability, and operator oversight in complex UAS vessel inspections.
HELM will develop a framework to execute and monitor AUTOASSESS UAS vessel-inspection missions. The project addresses the live operational phase of drone inspection: after a mission has been planned, but while it is being carried out, supervised and documented. HELM will link existing AUTOASSESS components, including the cloud infrastructure, UAS platforms and the human operator, helping to orchestrate mission progress and giving operators clear tools for oversight and intervention.
HELM will include two main components. The Mission Execution Engine will receive high-level mission plans, interpret them, translate them into commands for the relevant UAS platform, and manage mission state, lifecycle actions, basic fail-safes, telemetry and status updates, audit logs and synchronisation of mission outputs. It will also support variable connectivity conditions, including cases where only limited telemetry may be available.
The Graphical User Interface will provide operators with live mission monitoring, situational awareness and high-level human-in-the-loop control. It will display mission progress, UAS status, alerts, telemetry, available maps or point clouds, inspection readings, and video or images where available. It will also provide interfaces for mission lifecycle management and intervention actions such as start, pause, resume, abort, return-home and task repetition, where supported.
HELM will co-design its tools together with AUTOASSESS and operators, defining requirements and ensuring operational relevance and acceptance. It will define the structures for data exchanges between components, understand the mission parameters and manage mission execution through its lifecycle. The system will be validated and demonstrated in operational conditions in AUTOASSESS’s pilots.
By turning UAS mission execution into a clear operator workflow, HELM aims to reduce manual coordination, improve execution consistency, support safer inspection operations, and help operators supervise complex missions from a safe location. The project will deliver a deployed prototype, structured mission logs, a validated operator interface, and demonstration results showing how HELM can support live, traceable and human-centred UAS vessel inspection.
