Computer Science ›› 2020, Vol. 47 ›› Issue (6A): 161-165.doi: 10.11896/JsJkx.191200127

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Global Bilateral Segmentation Network for Segmantic Segmentation

REN Tian-ci1, HUANG Xiang-sheng2, DING Wei-li1, AN Chong-yang1 and ZHAI Peng-bo3   

  1. 1 Institute of Electrical Engineering,Yanshan University,Qinhuangdao,Hebei 066000,China
    2 Institute of Automation,Chinese Academy of Sciences,BeiJing 100190,China
    3 Institute of Microelectronics,Chinese Academy of Sciences,BeiJing 100029,China
  • Published:2020-07-07
  • About author:REN Tian-ci, born in 1995, postgradua-te.His main research interests include computer vision and pattern recognition.
    DING Wei-li, born in 1979, Ph.D, professor, Ph.D supervisor, is a member of China Computer Federation.Her main research interests include computer vision, pattern recognition and human-computer interaction.
  • Supported by:
    This work was supported by the National Key R&D Program of China (2018YFB1308302,2018YFB1308300) and Research on Key Technologies of texture acquisition and 3D reconstruction of complex obJect surface (61573356).

Abstract: The task of semantic segmentation is to predict the obJects according to the category at the pixel level.The difficulty lies in retaining enough spatial information and obtaining enough context information.In order to solve this problem,this paper proposes a global bilateral network semantic segmentation algorithm.In this algorithm,the large-scale convolution kernel is integrated into the BiSeNet Network,and the global path branches are added to the original spatial path and context path of the BiSeNet Network,so that the network can capture more context information.At the same time,the global pooling module in the attention optimization module and feature fusion module is replaced by the global convolution module to further improve the network acquisition.The experimental results show that the algorithm improves the MIoU index by 0.84% on Cityscaps dataset,and achieves better performance than BiSeNet Network.

Key words: Bilateral segmentation network, Global convolutional network, Semantic segmentation

CLC Number: 

  • TP389.1
[1] LONG J,SHELHAMER E,DARRELL T.Fully Convolutional Networks for Semantic Segmentation.IEEE Transactions on Pattern Analysis & Machine Intelligence,2014,39(4):640-651.
[2] BADRINARAYANAN V,HANDA A,CIPOLLA R.SegNet:A Deep Convolutional Encoder-Decoder Architecture for Image Segmentation. IEEE Transactions on Pattern Analysis and Machine Intelligence,2017,39(12):2481-2495.
[3] NOH H,HONG S,HAN B.Learning deconvolution network for semantic segmentation//Proceedings of the IEEE International Conference on Computer Vision.2015:1520-1528.
[4] RONNEBERGER O,FISCHER P,BROX T.U-net:Convolutional networks for biomedical image segmentation//International Conference on Medical image computing and computer-assisted intervention.Springer,Cham,2015:234-241.
[5] Lin G,Milan A,Shen C,et al.RefineNet:Multi-path refinement networks with identity mappings for high-resolution semantic segmentation.arXiv:1611.06612.
[6] CHEN L C,PAPANDREOU G,KOKKINOS I,et al.DeepLab:Semantic Image Segmentation with Deep Convolutional Nets,Atrous Convolution,and Fully Connected CRFs.IEEE Transactions on Pattern Analysis & Machine Intelligence,2016,40(4):834-848.
[7] CHEN L C,PAPANDREOU G,SCHROFF F,et al.Rethinking atrous convolution for semantic image segmentation.arXiv:1706.05587,2017.
[8] CHEN L C,ZHU Y,PAPANDREOU G,et al.Encoder-decoder with atrous separable convolution for semantic image segmentation//Proceedings of the European Conference on Computer vision (ECCV).2018:801-818.
[9] ZHAO H S,SHI J P,QI X J,et al.Pyramid Scene Parsing Network.arXiv:1612.01105v2,2017.
[10] ZHANG R,TANG S,ZHANG Y,et al.Scale-Adaptive Convolutions for Scene Parsing//2017 IEEE International Conference on Computer Vision (ICCV).IEEE,2017.
[11] YU C,WANG J,PENG C,et al.BiSeNet:Bilateral Segmentation Network for Real-Time Semantic Segmentation//Computer Vision-ECCV 2018.Lecture Notes in Computer Science, vol 11217.
[12] PENG C,ZHANG X,YU G,et al.Large Kernel Matters-Improve Semantic Segmentation by Global Convolutional Network//2017 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2017.
[13] SIMONYAN K, ZISSERMAN A.Very Deep ConvolutionalNetworks for Large-Scale Image Recognition.Computer Science,2014.
[14] SZEGEDY C,LIU W,JIA Y,et al.Going Deeper with Convolutions//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,MA,2015:1-9.
[15] CHEN L C,PAPANDREOU G,KOKKINOS I,et al.Semantic Image Segmentation with Deep Convolutional Nets and Fully Connected CRFs.Computer Science,2014(4):357-361.
[16] HU J,SHEN L,ALBANIE S,et al.Squeeze-and-Excitation Net-works.arXiv:1709.01507v4,2019.
[17] CORDTS M,OMRAN M,RAMOS S,et al.The Cityscapes Dataset for Semantic Urban Scene Understanding.arXiv:1604.01685,2016.
[18] BROSTOW G J,SHOTTON J,FAUQUEUR J,et al.Segmentation and Recognition Using Structure from Motion Point Clouds//European Conference on Computer Vision.Springer,Berlin,Heidelberg,2008.
[19] HE K,ZHANG X,REN S,et al.Deep Residual Learning for Image Recognition.arXiv:1512.03385,2015.
[1] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[2] HU Fu-yuan, WAN Xin-jun, SHEN Ming-fei, XU Jiang-lang, YAO Rui, TAO Zhong-ben. Survey Progress on Image Instance Segmentation Methods of Deep Convolutional Neural Network [J]. Computer Science, 2022, 49(5): 10-24.
[3] WANG Shi-yun, YANG Fan. Remote Sensing Image Semantic Segmentation Method Based on U-Net Feature Fusion Optimization Strategy [J]. Computer Science, 2021, 48(8): 162-168.
[4] ZHAN Rui, LEI Yin-jie, CHEN Xun-min, YE Shu-han. Street Scene Change Detection Based on Multiple Difference Features Network [J]. Computer Science, 2021, 48(2): 142-147.
[5] WANG Xin, ZHANG Hao-yu, LING Cheng. Semantic Segmentation of SAR Remote Sensing Image Based on U-Net Optimization [J]. Computer Science, 2021, 48(11A): 376-381.
[6] ZHU Rong, YE Kuan, YANG Bo, XIE Huan, ZHAO Lei. Feature Classification Method Based on Improved DeeplabV3+ [J]. Computer Science, 2021, 48(11A): 382-385.
[7] ZHOU Peng-cheng,GONG Sheng-rong,ZHONG Shan,BAO Zong-ming,DAI Xing-hua. Image Semantic Segmentation Based on Deep Feature Fusion [J]. Computer Science, 2020, 47(2): 126-134.
[8] WANG Sai-nan, ZHENG Xiong-feng. Application and Research of Image Semantic Segmentation Based on Edge Computing [J]. Computer Science, 2020, 47(11A): 276-280.
[9] YANG Pei-jian, WU Xiao-fu, ZHANG Suo-fei, ZHOU Quan. Semantic Segmentation Transfer Algorithm Based on Atrous Convolution Discriminator [J]. Computer Science, 2020, 47(11): 174-178.
[10] WANG Yan-ran, CHEN Qing-liang, WU Jun-jun. Research on Image Semantic Segmentation for Complex Environments [J]. Computer Science, 2019, 46(9): 36-46.
[11] MIAO Yong-wei, LI Gao-yi, BAO Chen, ZHANG Xu-dong, PENG Si-long. Image Localized Style Transfer Based on Convolutional Neural Network [J]. Computer Science, 2019, 46(9): 259-264.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!