Reasoning and learning services for coalition situational understanding

Dan Harborne; Ramya Raghavendra; Chris Willis; Supriyo Chakraborty; Pranita Dewan; Mudhakar Srivatsa; Richard Tomsett; Alun Preece

doi:10.1117/12.2307009

4 May 2018 Reasoning and learning services for coalition situational understanding

Dan Harborne, Ramya Raghavendra, Chris Willis, Supriyo Chakraborty, Pranita Dewan, Mudhakar Srivatsa, Richard Tomsett, Alun Preece

Author Affiliations +

Proceedings Volume 10635, Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX; 106350V (2018) https://doi.org/10.1117/12.2307009
Event: SPIE Defense + Security, 2018, Orlando, FL, United States

Abstract

Situational understanding requires an ability to assess the current situation and anticipate future situations, requiring both pattern recognition and inference. A coalition involves multiple agencies sharing information and analytics. This paper considers how to harness distributed information sources, including multimodal sensors, together with machine learning and reasoning services, to perform situational understanding in a coalition context. To exemplify the approach we focus on a technology integration experiment in which multimodal data — including video and still imagery, geospatial and weather data — is processed and fused in a service-oriented architecture by heterogeneous pattern recognition and inference components. We show how the architecture: (i) provides awareness of the current situation and prediction of future states, (ii) is robust to individual service failure, (iii) supports the generation of ‘why’ explanations for human analysts (including from components based on ‘black box’ deep neural networks which pose particular challenges to explanation generation), and (iv) allows for the imposition of information sharing constraints in a coalition context where there is varying levels of trust between partner agencies.

Conference Presentation

Citation Download Citation

Dan Harborne, Ramya Raghavendra, Chris Willis, Supriyo Chakraborty, Pranita Dewan, Mudhakar Srivatsa, Richard Tomsett, and Alun Preece "Reasoning and learning services for coalition situational understanding", Proc. SPIE 10635, Ground/Air Multisensor Interoperability, Integration, and Networking for Persistent ISR IX, 106350V (4 May 2018); https://doi.org/10.1117/12.2307009

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available