Inspection of commerce entering the country is currently a burdensome process, assisted greatly by non-intrusive inspection (NII) technologies such as X-Ray imaging. There are a variety of singular ML techniques that assist in the adjudication process, many are well known, common and widely available with proper data. However, the challenge is to develop a comprehensive system exhibiting certain properties that leverages many techniques simultaneously and combines results to improve overall performance. Here we describe the concepts, components, data and implementation of a system we use for NII adjudication that is well suited to adapting to future needs. We demonstrate several components of this system the benefits of it. Specifically, we show the combination of results from common methods achieves superior performance in concert. First, ensembeling has proven successful in combining results from a variety of object detection models. We show the impact of using our novel graph clique-based method to increase performance over independent models. Additionally, because of performant and reliable object detection results, we demonstrate how constructing an image level contextualization of a scene allows analysis at the metadata level. Lastly, we leverage variational autoencoder (VAE) based similarity models to describe anomalies. We deploy these algorithms in a hierarchical fashion, developing optical signatures for whole NII scans as well as their components (e.g, entire vehicle, trunk, wheels). Here, we quantify the impacts of the inclusion of these methods in image anomaly detection task and demonstrate them in the extensible framework we have developed for NII applications. This paper will serve as an overview of our approach and show results from both combinatorial techniques.
Large scale non-intrusive inspection (NII) of commercial vehicles is being adopted in the U.S. at a pace and scale that will result in a commensurate growth in adjudication burdens at land ports of entry. The use of computer vision and machine learning models to augment human operator capabilities is critical in this sector to ensure the flow of commerce and to maintain efficient and reliable security operations. The development of models for this scale and speed requires novel approaches to object detection and novel adjudication pipelines. Here we propose a notional combination of existing object detection tools using a novel ensembling framework to demonstrate the potential for hierarchical and recursive operations. Further, we explore the combination of object detection with image similarity as an adjacent capability to provide post-hoc oversight to the detection framework. The experiments described herein, while notional and intended for illustrative purposes, demonstrate that the judicious combination of diverse algorithms can result in a resilient workflow for the NII environment.
Access to the requested content is limited to institutions that have purchased or subscribe to SPIE eBooks.
You are receiving this notice because your organization may not have SPIE eBooks access.*
*Shibboleth/Open Athens users─please
sign in
to access your institution's subscriptions.
To obtain this item, you may purchase the complete book in print or electronic format on
SPIE.org.
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.