Computer Science ›› 2021, Vol. 48 ›› Issue (8): 150-156.doi: 10.11896/jsjkx.200800221

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Binocular Image Segmentation Based on Graph Cuts Multi-feature Selection

JIN Hai-yan1,2, PENG Jing1, ZHOU Ting1, XIAO Zhao-lin1,2   

  1. 1 School of Computer Science and Engineering,Xi'an University of Technology,Xi'an 710048,China;
    2 Shaanxi Key Laboratory for Network Computing and Security Technology,Xi'an 710048,China
  • Received:2020-08-30 Revised:2020-09-27 Published:2021-08-10
  • About author:JIN Hai-yan,born in 1976,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.Her main researchinterests include computer vision,image processing,intelligent information processing and so on.( Zhao-lin,born in 1984,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include computer vision,computational photography and so on.
  • Supported by:
    National Natural Science Foundation of China(61871319) and Shaanxi Province Technical Innovation Guidance Special (2020CGXNG-026).

Abstract: Binocular image segmentation is crucial for subsequent applications such as stereoscopic object synthesis and 3D reconstruction.Since binocular images contain scene depth information,it is difficult to obtain ideal segmentation results by applying monocular image segmentation methods to binocular images directly.At present,most binocular image segmentation methods use the depth feature of the binocular image as an additional channel for the color feature.Only the color feature and the depth feature are simply integrated,and the depth feature of the image cannot be fully utilized.Based on the multi-class Graph Cuts framework,this paper proposes an interactive binocular image segmentation method.Combining features such as color,depth and texture into a graph model can make full use of different feature information.At the same time,the feature space neighborhood system is introduced in the Graph Cuts framework,which enhances the relationship between the pixels in the foreground and background areas of the image,and improves the integrity of the segmentation target.Experimental results show that the proposed method improves the accuracy of binocular image segmentation results effectively.

Key words: Binocular image, Binocular stereo vision, Graph cuts, Image segmentation

CLC Number: 

  • TP391.4
[1]KOLMOGOROV V,ZABIN R.What energy functions can beminimized via graph cuts[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(2):147-159.
[2]BOYKOV Y,KOLMOGOROV V.An experimental comparison of min-cut/max-flow algorithms for energy minimization in vision[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2004,26(9):1124-1137.
[3]LIANG L M,HUANG C L,SHI F.Horizontal set of fusion shape priori for fundus image vascular segmentation[J].Journal of Computer Science,2018,41(7):1678-1692.
[4]ZHU Z L,LIU Y J.Fusion chaos optimization and improvedfuzzy clustering for image segmentation algorithm[J].Electronic Journals,2020,48(5):975-984.
[5]LI Y,CHEN X,ZHU Z,et al.Attention-Guided Unified Network for Panoptic Segmentation[C]//IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).2019:7019-7028.
[6]ZHANG Z L,LI A H,CHU W.Hyperpixel segmentation algorithm based on density peak search clustering[J].Chinese Journal of Computers,2020,43(1):1-15.
[7]QIN H F,LIU X.Finger Vein Image Segmentation Based onSparse Auto-Encoder[J].Journal of Chongqing Technology and Business University(Natural Science Edition),2019,36(4):1-8.
[8]HE T,GUO Y G,XIN C H.ACM selection system combined with improved Chan-Vese model adaptive image segmentation method[J].Journal of Chongqing University of Technology (Natural Science),2020,34(2):165-173.
[9]YANG Z,WANG J,XIN C H.Automatic Segmentation andClassification of MR Images Using DCE-MRI Combined with Improved Convolutional Neural Network[J].Journal of Chongqing University of Technology (Natural Science),2020,34(2):147-157.
[10]WANG R H,LI B,TENG Q Z.Core FIB-SEM Image Segmentation Algorithm Based on Convolutional Neural Network[J].Computer Engineering,2021,47(1):264-274.
[11]LI P,CHEN J Q,MA W M,et al.Sonar Image Segmentation Based on Multiscale Features in Contourlet Domain[J].Computer Engineering,2019,45(9):253-259.
[12]PRICE B L,MORSE B S,COHEN S.LIVEcut:Learning-basedinteractive video segmentation by evaluation of multiple propagated cues[C]//Proceedings of the 2009 IEEE 12th Internatio-nal Conference on Computer Vision.Kyoto.2009:779-786.
[13]SUN C,LU H.Interactive Video Segmentation via Local Ap-pearance Model [J].IEEE Transactions on Circuits and Systems for Video Technology.2017,27(7):1491-1501.
[14]ZHOU C,LIU C.Co-segmentation of multiple similar imagesusing saliency detection and region merging [J].Iet Computer Vision,2014,8(3):254-261.
[15]LI Y,ZHANG J,GAO P,et al.Grab Cut Image Segmentation Based on Image Region[C]//2018 IEEE 3rd International Conference on Image,Vision and Computing(ICIVC).2018:311-315.
[16]BATRA D,KOWDLE A,PARIKH D,et al.iCoseg:Interactive co-segmentation with intelligent scribble guidance[C]//Procee-dings of the 2010 IEEE Computer Society Conference on Compu-ter Vision and Pattern Recognition.2010:3169-3176.
[17]LI Z,LIU J,YANG Y,et al.Clustering-Guided Sparse Structu-ral Learning for Unsupervised Feature Selection[J].IEEE Transactions on Knowledge and Data Engineering,2014,26(9):2138-2150.
[18]LI Z,TANG J.Unsupervised Feature Selection via Nonnegative Spectral Analysis and Redundancy Control[J].IEEE Transactions on Image Processing,2015,24(2):5343-5355.
[19]LI X,ZHANG H,ZHANG R,et al.Discriminative and Uncorre-lated Feature Selection with Constrained Spectral Analysis in Unsupervised Learning[J].IEEE Transactions on Image Processing,2020,29:2139-2149.
[20]LO W Y,BAAR J V,KNAUS C,et al.Stereoscopic 3D Copy & Paste[J].Acm Transactions on Graphics.2010,29(6):147.
[21]PRICE B L,COHEN S.StereoCut:Consistent interactive object selection in stereo image pairs[C]//Proceedings of the 2011 International Conference on Computer Vision.Barcelona,2011:1148-1155.
[22]JU R,XU X,YANG Y,et al.Stereo GrabCut:Interactive and Consistent Object Extraction for Stereo Images[C]//Procee-dings of the Advances in Multimedia Information Processing(PCM 2013).2013:418-429.
[23]MA W,YANG L,ZHANG Y,et al.Fast interactive stereoimage segmentation[J].Multimedia Tools and Applications,2016,75(18):10935-10948.
[24]MA W,QIN Y,YANG L,et al.Interactive Stereo Image Seg-mentation with RGB-D Hybrid Constraints[J].IEEE Signal Processing Letters,2016,23(11):1533-1537.
[25]PENG J,SHEN J,LI X.High-Order Energies for Stereo Seg-mentation[J].IEEE Transactions on Cybernetics,2016,46(7):1616-1627.
[26]JU R,REN T,WU G.StereoSnakes:Contour Based Consistent Object Extraction for Stereo Images[C]//Proceedings of the 2015 IEEE International Conference on Computer Vision (ICCV).2015:1724-1732.
[27]BOYKOV Y Y,JOLLY M.Interactive graph cuts for optimalboundary & region segmentation of objects in N-D images[C]//Proceedings of the Eighth IEEE International Conference on Computer Vision(ICCV 2001).2001:105-112.
[28]ZHANG K,FANG Y,MIN D,et al.Cross-scale cost aggregation for stereo matching[J].IEEE Transactions on Circuits and Systems for Video Technology.2017,27(5):965-976.
[29]ARBELÁEZ P,MAIRE M,FOWLKES C,et al.Contour Detection and Hierarchical Image Segmentation[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(5):898-916.
[1] ZHU Yi-fan, WANG Hai-tao, LI Ke, WU He-jun. Crack U-Net:Towards High Quality Pavement Crack Detection [J]. Computer Science, 2022, 49(1): 204-211.
[2] YE Zhong-yu, WU Meng-lin. Choroidal Neovascularization Segmentation Combining Temporal Supervision and Attention Mechanism [J]. Computer Science, 2021, 48(8): 118-124.
[3] XU Hua-jie, ZHANG Chen-qiang, SU Guo-shao. Accurate Segmentation Method of Aerial Photography Buildings Based on Deep Convolutional Residual Network [J]. Computer Science, 2021, 48(8): 169-174.
[4] YANG Xiu-zhang, WU Shuai, XIA Huan, YU Xiao-min. Research on Shui Characters Extraction and Recognition Based on Adaptive Image Enhancement Technology [J]. Computer Science, 2021, 48(6A): 74-79.
[5] CAO Lin, YU Wei-wei. Adaptive Window Binocular Stereo Matching Algorithm Based on Image Segmentation [J]. Computer Science, 2021, 48(11A): 314-318.
[6] GU Xing-jian, ZHU Jian-feng, REN Shou-gang, XIONG Ying-jun, XU Huan-liang. Multi-scale U Network Realizes Segmentation and Recognition of Tomato Leaf Disease [J]. Computer Science, 2021, 48(11A): 360-366.
[7] YANG Zhi-wei, DAI Ming and ZHOU Zhi-heng. Surface Defect Detection Method of Industrial Products Based on Histogram Difference [J]. Computer Science, 2020, 47(6A): 247-249.
[8] CAO Yi-qin, DUAN Ye-yu, WU Dan. 2D-Otsu Rail Defect Image Segmentation Method Based on WFSOA [J]. Computer Science, 2020, 47(5): 154-160.
[9] RAO Meng,MIAO Duo-qian,LUO Sheng. Rough Uncertain Image Segmentation Method [J]. Computer Science, 2020, 47(2): 72-75.
[10] LEI Tao,LIAN Qian,JIA Xiao-hong,LIU Peng. Fast Simple Linear Iterative Clustering for Image Superpixel Algorithm [J]. Computer Science, 2020, 47(2): 143-149.
[11] ZHOU Yue-yong,CHENG Jiang-hua,LIU Tong,WANG Yang,CHEN Ming-hui. Review of Road Extraction for High-resolution SAR Images [J]. Computer Science, 2020, 47(1): 124-135.
[12] WANG Yan-ran, CHEN Qing-liang, WU Jun-jun. Research on Image Semantic Segmentation for Complex Environments [J]. Computer Science, 2019, 46(9): 36-46.
[13] LIU Chang-qi, SHAO Kun, HUO Xing, FAN Dong-yang, TAN Jie-qing. K-means Image Segmentation Algorithm Based on Weighted Quality Evaluation Function [J]. Computer Science, 2019, 46(6A): 158-160.
[14] PENG Jin-xi, SU Yuan-qi, XUE Xiao-rong. SAR Image Feature Retrieval Method Based on Deep Learning and Synchronic Matrix [J]. Computer Science, 2019, 46(6A): 196-199.
[15] ZHOU Xiao-long, CHEN Xiao-jia, CHEN Sheng-yong, LEI Bang-jun. Weakly Supervised Learning-based Object Detection:A Survey [J]. Computer Science, 2019, 46(11): 49-57.
Full text



No Suggested Reading articles found!