Dual-CNN fusion panoptic segmentation based on edge optimization

Yaling Li; Xiaoyan Luo; Xiaofeng Shi

doi:10.1117/12.2617704

15 February 2022 Dual-CNN fusion panoptic segmentation based on edge optimization

Yaling Li, Xiaoyan Luo, Xiaofeng Shi

Proceedings Volume 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021); 121665Z (2022) https://doi.org/10.1117/12.2617704
Event: Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 2021, Hong Kong, Hong Kong

Abstract

As a newly proposed research topic in recent years, panoptic segmentation is the combination of semantic segmentation and instance segmentation. The difficulties of panoptic segmentation include not only the common problems in traditional segmentation tasks, such as small object segmentation and low edge segmentation accuracy, but also the two-way fusion and the determination of conflicts. Considering the defect of edge segmentation, we use the edge optimization module SegFix based on edge detection and direction prediction for edge optimization, which reaches higher accuracy and shortens the calculation time by 3 times compared with Dense CRF. Based on the dual CNN fusion, we select EfficientNet as the baseline, which is more efficient, with depthwise separable convolutions and Mask R-CNN to achieve two-way segmentation. In addition, we use SegFix in multiple panoptic segmentation models to verify its versatility in panoptic segmentation. Finally, our PQ on the Cityscapes validation set reaches 65.5, which achieves the state-of-the-art result with all other panoptic segmentation models under the same experimental conditions, and we confirm that the edge optimization algorithm we use is universal for panoptic segmentation, and its consequence is better than other edge optimization algorithms.

Citation Download Citation

Yaling Li, Xiaoyan Luo, and Xiaofeng Shi "Dual-CNN fusion panoptic segmentation based on edge optimization", Proc. SPIE 12166, Seventh Asia Pacific Conference on Optics Manufacture and 2021 International Forum of Young Scientists on Advanced Optical Manufacturing (APCOM and YSAOM 2021), 121665Z (15 February 2022); https://doi.org/10.1117/12.2617704

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available

Members: $17.00

Non-members: $21.00 ADD TO CART

PROCEEDINGS
11 PAGES

DOWNLOAD PAPER SAVE TO MY LIBRARY

GET CITATION

RIGHTS & PERMISSIONS

Get copyright permission Get copyright permission on Copyright Marketplace

KEYWORDS

Image segmentation

Optimization (mathematics)

Convolution

Feature extraction

RGB color model

Image processing

Image filtering

Show All Keywords

Keywords/Phrases

Search In:

Publication Years