Discrepancy-guided dual-branch semantic segmentation

Jinghai Cheng

doi:10.1117/12.2685757

15 August 2023 Discrepancy-guided dual-branch semantic segmentation

Jinghai Cheng

Proceedings Volume 12719, Second International Conference on Electronic Information Technology (EIT 2023); 127191V (2023) https://doi.org/10.1117/12.2685757
Event: Second International Conference on Electronic Information Technology (EIT 2023), 2023, Wuhan, China

Abstract

In order to improve the feature extraction process in the semantic segmentation network and clarify the operating logic of the model, this paper splits the discriminative features according to the pixel's own information and the inter-pixel correlation information. Using two branch networks, relational branch and information branch to focus on the extraction of their own features, and using the fully convolutional segmentation head and the fully-connected segmentation head respectively to make the features more in line with the requirements of the branch itself. In order to make full use of the information contained in the discrepancy between the two branches, a Discrepancy-guided Fusion module is proposed at the feature level, in where the difference information between the features is used as a guide to promote the fusion of the features of the two branches. At the prediction level, with the help of Point-wise Discrepancy Cross Entropy loss, the prediction difference is used to determine the network's attention to each pixel. The effectiveness of the method is verified by extensive experiments on the Cityscapes dataset.

Citation Download Citation

Jinghai Cheng "Discrepancy-guided dual-branch semantic segmentation", Proc. SPIE 12719, Second International Conference on Electronic Information Technology (EIT 2023), 127191V (15 August 2023); https://doi.org/10.1117/12.2685757

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available