Research on semantic segmentation method of urban streetscape image based on deep learning

Peixin Gan; Xiaoyan Luo; Bo Liu; Lu Li; Xiaofeng Shi

doi:10.1117/12.2623440

15 February 2022 Research on semantic segmentation method of urban streetscape image based on deep learning

Peixin Gan, Xiaoyan Luo, Bo Liu, Lu Li, Xiaofeng Shi

Proceedings Volume 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021); 1216681 (2022) https://doi.org/10.1117/12.2623440
Event: Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 2021, Hong Kong, Hong Kong

Abstract

In computer vision technology, semantic segmentation technology occupies a very important area, which is widely used in driverless and other fields. Semantic segmentation of urban streetscape image is a difficult task, improving segmentation accuracy has been one of the ultimate goal for a long time. There are some problems in segmentation accuracy, including insufficient access to context information and the dim segmentation results at the edge of different objects. Here, based on the full convolution neural network (FCN) in deep learning, we select duel attention network (DANet)¹ as our baseline, which introduces attention mechanism to detect context information and its mIoU on Cityscapes reaches 0.646 and pixAcc reaches 0.941. Besides, we try to get richer multiscale context information by replacing the position attention module (PAM) with compact position attention module (CPAM) . In addition, we use a loss function based on distance to edge and the number of new pixels to adjust the imbalance between positive and negative samples. Finally, compared to the baseline, the former figure rises 1.5 percent and the latter rises 1.8 percent. The accuracy of semantic edge segmentation is improved.

Citation Download Citation

Peixin Gan, Xiaoyan Luo, Bo Liu, Lu Li, and Xiaofeng Shi "Research on semantic segmentation method of urban streetscape image based on deep learning", Proc. SPIE 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 1216681 (15 February 2022); https://doi.org/10.1117/12.2623440

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
8 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Convolution

Computer vision technology

Image analysis

Image processing

Lithium

Lutetium

Show All Keywords

Keywords/Phrases

Search In:

Publication Years