Paper
8 June 2023 A superglue image registration algorithm based on adaptive dynamic attention mechanism
QingSong Hong, TianXiang Zhao, Yong Zhang
Author Affiliations +
Proceedings Volume 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023); 127074E (2023) https://doi.org/10.1117/12.2681017
Event: International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 2023, Changsha, China
Abstract
To improve image alignment quality, we propose a SuperGlue-based image alignment algorithm, which is an adaptive dynamic graph attention mechanism. The method first uses a deep learning method (SuperPoint) for feature point extraction to get the position, confidence, and encoding vectors of feature points. Next, a multilayer perceptron is used to embed the position, confidence, and encoding vectors together into a high-dimensional vector, and then the information of neighboring points is aggregated using an adaptive attention mechanism to make its node representation vector unique. Meanwhile, to avoid the performance impairment caused by full connectivity, the information range of aggregation is adaptively decayed according to the number of extracted feature points and the number of iterative layers. As the number of layers increases, the information is continuously passed, the graph is continuously updated, and finally the descriptors with unique properties are obtained. Finally, the matching results are obtained by solving the score matrix. The experimental results show that the image alignment quality of our method is improved over previous image alignment algorithms.
© (2023) COPYRIGHT Society of Photo-Optical Instrumentation Engineers (SPIE). Downloading of the abstract is permitted for personal use only.
QingSong Hong, TianXiang Zhao, and Yong Zhang "A superglue image registration algorithm based on adaptive dynamic attention mechanism", Proc. SPIE 12707, International Conference on Image, Signal Processing, and Pattern Recognition (ISPP 2023), 127074E (8 June 2023); https://doi.org/10.1117/12.2681017
Advertisement
Advertisement
RIGHTS & PERMISSIONS
Get copyright permission  Get copyright permission on Copyright Marketplace
KEYWORDS
Feature extraction

Image registration

Neural networks

Image processing

Deep learning

Back to Top