Computer Science ›› 2021, Vol. 48 ›› Issue (11A): 314-318.doi: 10.11896/jsjkx.201200264

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Adaptive Window Binocular Stereo Matching Algorithm Based on Image Segmentation

CAO Lin, YU Wei-wei   

  1. School of Information Engineering,Shanghai University of Maritime,Shanghai 201306,China
  • Online:2021-11-10 Published:2021-11-12
  • About author:CAO Lin,born in 1991,postgraduate.Her main research interests include computer vision and image processing.
    YU Wei-wei,born in 1978,Ph.D,asso-ciate professor.Her main research interests include pattern recognition,image processing and data mining.

Abstract: Aiming at the problem that the traditional binocular stereo matching algorithm uses fixed window,which leads to low matching accuracy in weak texture regions,an adaptive window stereo matching algorithm based on image segmentation is proposed.Firstly,the mean shift algorithm is used to segment the image,and then the gray standard deviation of local sub regions is calculated.Based on this,an adaptive window size setting operator is proposed according to the texture richness.Based on the adaptive window size setting,the matching cost is calculated by combining census transform and gradient value,and the initial disparity is calculated by adaptive weight cost aggregation and “winner takeall” strategy respectively.Finally,the dense disparity map is obtained by using the principle of left and right disparity consistency and weighted median filtering.The adaptive window matching algorithm and fixed window matching algorithm proposed in this paper are used to match standard images on Middlebury dataset.The experimental results show that the average matching error rate of the proposed algorithm is 2.04%,which is 4.5% and 7.9% lower than that of the contrast algorithm.

Key words: Adaptive weight, Adaptive window, Image segmentation, Stereo matching, Weak texture

CLC Number: 

  • TP311.5
[1]ZHANG S.Recent progresses on real-time 3D shape measurement using digital fringe projection techniques[J].Optics and Lasers in Engineering,2009,48(2):149-158.
[2]KIEU H,PAN T Y,WANG Z Y,et al.Accurate 3D shapemeasurement of multiple separate objects with stereo vision[J].Measurement Science and Technology,2014,25(3):1-7.
[3]JIANG S,HONG Z,ZHANG Y,et al.Automatic path planning and navigation with stereo cameras[C]//2014 3rd International Workshop on Earth Observation and Remote Sensing Applications (EORSA).IEEE,2014:289-293.
[4]SUHR J K.Automatic free parking space detection by using motion stereo-based 3D reconstruction[J].Machine Vision &Applications,2010,21(2):163-176.
[5]BRUNO F,BIANCO G,MUZZUPAPPA M,et al.Experimentation of structured light and stereo vision for underwater 3D reconstruction[J].ISPRS Journal of Photogrammetry and Remote Sensing,2011,66(4):508-518.
[6]ZHANG J,MCMILLAN L,YU J.Robust Tracking and Stereo Matching under Variable Illumination[C]//IEEE Computer Society Conference on Computer Vision & Pattern Recognition.2006(1):871-878.
[7]TIPPETTS B,LEE D J,LILLYWHITE K,et al.Review of ste-reo vision algorithms and their suitability for resource-limited systems[J].Journal of Real-Time Image Processing,2016,11(1):5-25.
[8]BROWN M Z,BURSCHKA D,HAGER G D.Advances in Computational Stereo[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2003,25(8):993-1008.
[9]KLAUS A.Segment-based stereo matching using belief propagation and a self-adapting dissimilarity measure[J].InternationalConference on Pattern Recognition,2006(3):15-18
[10]HU T,QI B,WU T,et al.Stereo matching using weighted dynamic programming on a single-direction four-connected tree[J].Computer Vision & Image Understanding,2012,116(8):908-921.
[11]XU Y Y,XU X Y,YU R.Disparity Optimization Algorithm for Stereo Matching Using Improved Guided Filter[J].Journal of Advanced Computational Intelligence and Intelligent Informati-cs,2019,23(4):625-633.
[12]YU H B,HU Y L,XU J.Stereo matching algorithm based on multi feature fusion and tree structure cost aggregation[J].Journal of Shanghai University (Natural Science Edition),2019,25(1):66-74.
[13]ZHANG Z.A flexible New Technique for Camera Calibration[J].IEEETransactions on Pattern and Machine Intelligence,2000,22(11):1330-1334.
[14]TAO H,SAWHNEY H S,KUMAR R.Aglobal matchingframework for stereo computation[C]//IEEE International Conference on Computer Vision Vancouver.2001:523-539.
[15]ZHANG Y F,LI X F,TIAN X D.Stereo matching algorithm based on image segmentation[J].Computer Applications,2020,40(5):1415-1420.
[16]CMANICIU D,MEER P.Mean Shift:A Robust Approach Toward Feature Space Analysis[J].IEEE TransactionsPattern Analysis and Machine Intelligence,2002,24(5):603-619.
[17]YANG Q,WANG L,YANG R,et al.Stereo Matching with Color-Weighted Correlation,Hierarchical Belief Propagation,and Occlusion Handling[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2009,31(3):492-504.
[18]SCHARSTEIN D,H HIRSCHMÜLLER,KITAJIMA Y,et al.High-Resolution Stereo Datasets with Subpixel-Accurate Ground Truth[C]//German Conference on Pattern Recognition.Springer International Publishing,2014:31-42.
[19]HIRSCHMÜLLER H,SCHARSTEIN D.Evaluation of CostFunctions for Stereo Matching[C]//IEEE Conference on Com-puter Vision & Pattern Recognition.IEEE,2007:1-8.
[1] ZHAO Liang, ZHANG Jie, CHEN Zhi-kui. Adaptive Multimodal Robust Feature Learning Based on Dual Graph-regularization [J]. Computer Science, 2022, 49(4): 124-133.
[2] ZHU Yi-fan, WANG Hai-tao, LI Ke, WU He-jun. Crack U-Net:Towards High Quality Pavement Crack Detection [J]. Computer Science, 2022, 49(1): 204-211.
[3] ZHANG Peng, WANG Xin-qing, XIAO Yi, DUAN Bao-guo, XU Hong-hui. Real-time Binocular Depth Estimation Algorithm Based on Semantic Edge Drive [J]. Computer Science, 2021, 48(9): 216-222.
[4] YE Zhong-yu, WU Meng-lin. Choroidal Neovascularization Segmentation Combining Temporal Supervision and Attention Mechanism [J]. Computer Science, 2021, 48(8): 118-124.
[5] JIN Hai-yan, PENG Jing, ZHOU Ting, XIAO Zhao-lin. Binocular Image Segmentation Based on Graph Cuts Multi-feature Selection [J]. Computer Science, 2021, 48(8): 150-156.
[6] XU Hua-jie, ZHANG Chen-qiang, SU Guo-shao. Accurate Segmentation Method of Aerial Photography Buildings Based on Deep Convolutional Residual Network [J]. Computer Science, 2021, 48(8): 169-174.
[7] YANG Xiu-zhang, WU Shuai, XIA Huan, YU Xiao-min. Research on Shui Characters Extraction and Recognition Based on Adaptive Image Enhancement Technology [J]. Computer Science, 2021, 48(6A): 74-79.
[8] GU Xing-jian, ZHU Jian-feng, REN Shou-gang, XIONG Ying-jun, XU Huan-liang. Multi-scale U Network Realizes Segmentation and Recognition of Tomato Leaf Disease [J]. Computer Science, 2021, 48(11A): 360-366.
[9] SANG Miao-miao, PENG Jin-xian, DA Tong-hang, ZHANG Xu-feng. Efficient Semi-global Binocular Stereo Matching Algorithm Based on PatchMatch [J]. Computer Science, 2021, 48(1): 204-208.
[10] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
[11] CHENG Zhong-Jian, ZHOU Shuang-e and LI Kang. Sparse Representation Target Tracking Algorithm Based on Multi-scale Adaptive Weight [J]. Computer Science, 2020, 47(6A): 181-186.
[12] YANG Zhi-wei, DAI Ming and ZHOU Zhi-heng. Surface Defect Detection Method of Industrial Products Based on Histogram Difference [J]. Computer Science, 2020, 47(6A): 247-249.
[13] CAO Yi-qin, DUAN Ye-yu, WU Dan. 2D-Otsu Rail Defect Image Segmentation Method Based on WFSOA [J]. Computer Science, 2020, 47(5): 154-160.
[14] YANG Ting, LUO Fei, DING Wei-chao, LU Hai-feng. Bin Packing Algorithm Based on Adaptive Optimization of Slack [J]. Computer Science, 2020, 47(4): 211-216.
[15] RAO Meng,MIAO Duo-qian,LUO Sheng. Rough Uncertain Image Segmentation Method [J]. Computer Science, 2020, 47(2): 72-75.
Full text



No Suggested Reading articles found!