- Computer Science Laboratory

COLLIARD Valentin

PhD Student at Sorbonne University
Team : SMA
    Sorbonne Université - LIP6
    Boîte courrier 169
    Couloir 25-26, Étage 4, Bureau 420
    4 place Jussieu
    75252 PARIS CEDEX 05
    FRANCE

+33 1 44 27 88 40
Valentin.Colliard (at) nulllip6.fr
https://lip6.fr/Valentin.Colliard

Supervision : Amal EL FALLAH SEGHROUCHNI
Co-supervision : CORRUBLE Vincent, PÉRES Alain

Deep Reinforcement Learning and Air Defense : Towards a Robust and Explainable Decision-Support Tool for Command and Control

Recent technological advances have brought about a revolution in the world of air defense. By air defense, we mean all the measures and systems designed to detect, identify, track, and neutralize aerial threats. With the emergence of new threats, such as small-sized or medium-sized drones or hypersonic or highly maneuverable threats, the battlefield is becoming increasingly complex for operators to analyze.

Current methods, combining decisions made by human operators and rule-based algorithms or heuristics, suffer from a lack of responsiveness and robustness in the face of these new threats. In this thesis, we explore the potential of deep reinforcement learning to develop real-time adaptive defensive strategies. The contributions of this thesis are structured around three areas. First, we have implemented deep reinforcement learning algorithms that outperform rule-based methods by adapting to the situations they encounter, whereas deterministic strategies remain limited when faced with the complexity and variability of the environment.

Next, we demonstrate that these agents are capable of robustly transferring knowledge learned from a source scenario to a target scenario.

Finally, by leveraging the self-attention mechanism, we address the explainability of decisions obtained by Deep Reinforcement Learning, an essential step to foster the acceptability of this type of approach and their adoption in an operational context.


Phd defence : 07/15/2025

Jury members :

Ann Nowé, Professeure à Vrije Universiteit Brussel [Rapporteur]
Charles Madeira, Professeur à L'Université Fédérale du Rio Grande do Norte [Rapporteur]
Gauthier Picard, Directeur de Recherche à l’ONERA
Pierre-Henri Wuillemin, Maître de Conférence à Sorbonne Université
Amal El Fallah Seghrouchni, Professeure à Sorbonne Université
Vincent Corruble, Maître de Conférence à Sorbonne Université
Alain Peres, Architecte Système à Thales LAS France

2025 Publications