Explainable Reinforcement Learning for assisting Air Traffic Controllers

Computer Vision & MultiModal AI
Published: arXiv: 2607.22525v1
Authors

Anduel Mehmeti Gabriella Gigante Salvatore Venticinque

Abstract

To effectively integrate AI into high-stakes, critical environments such as healthcare, autonomous driving, and aviation--and to advance toward higher levels of automation and seamless human-AI collaboration--building trust in AI-driven solutions is essential. Trust, in turn, is closely linked to the explainability of AI systems. The rapid advancements in AI across various domains have underscored the challenges of establishing trust, raising increasing interest in AI explainability even more when applied to deep learning. In this context, the present work aims to explore the application of explainability techniques to Reinforcement Learning (RL) algorithms, specifically within the safety-critical domain of Air Traffic Control (ATC). Using a simplified ATC environment as an initial testbed, an intelligent agent is trained with a reinforcement learning algorithm to make decisions on alternative flight routes that avoid no-fly zones. As a preliminary explainability approach, a saliency map is employed, providing insights into the input features that most significantly influence the agent's decision-making process.

Paper Summary

Problem
Air traffic controllers face a complex task in ensuring safe and efficient air traffic management, particularly with the rapid growth in global air traffic. Building trust in AI-driven solutions is essential for seamless human-AI collaboration in high-stakes environments like aviation. However, the lack of explainability in AI systems hinders the establishment of trust, making it challenging to integrate AI into critical environments.
Key Innovation
This research introduces explainability techniques to Reinforcement Learning (RL) algorithms in the safety-critical domain of Air Traffic Control (ATC). By employing a saliency map, the study provides insights into the input features that significantly influence the agent's decision-making process, promoting transparency and trustworthiness.
Practical Impact
The practical application of this research lies in developing a decision-support system for air traffic controllers that ensures safe and efficient en-route navigation. By incorporating an explainability layer, the system's interpretability and trustworthiness are improved, enabling human operators to understand the decision-making processes of the RL agent. This can lead to enhanced collaboration between humans and AI systems in air traffic management, ultimately improving safety and efficiency.
Analogy / Intuitive Explanation
Imagine being a pilot navigating through a busy airspace. The AI system is like a co-pilot that helps make decisions about the best route to take, avoiding no-fly zones and ensuring safe passage. However, just as a pilot needs to understand why the co-pilot recommends a particular route, the AI system's decision-making process must be transparent and explainable to build trust and facilitate seamless collaboration. The saliency map is like a dashboard that shows the pilot (or air traffic controller) which factors influenced the co-pilot's decision, making it easier to understand and trust the AI system.
Paper Information
Categories:
cs.AI
Published Date:

arXiv ID:

2607.22525v1

Quick Actions