Computer Science ›› 2020, Vol. 47 ›› Issue (3): 130-136.doi: 10.11896/jsjkx.190100239

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Grid-driven Bi-directional Image Stitching Algorithm

PANG Rong,LAI Lin-jing,ZHANG Lei   

  1. (School of Computing, Beijing Institute of Technology, Beijing 100081, China)
  • Received:2019-01-29 Online:2020-03-15 Published:2020-03-30
  • About author:PANG Rong,born in 1994,postgra-duate.His research interests include image and video processing. LAI Lin-jing, born in 1980,master,assistant researcher.Her research inte-rests include image and video.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61772069).

Abstract: Image stitching is to merge multiple images from different views into one image with a wider view.This requires the minimum of both ghosting in the overlapping region and distortion in the non-overlapping region.This paper proposed a grid-drivenbi-directional image stitching algorithm based on the Moving DLT.As for the overlapping region,this paper uses bi-directional Moving DLT to align feature points and judge the way of image overlapping by the quantitative evaluation,which has accurate stitching and less ghosting.As for the non-overlapping region,the interpolation of mesh vertices after homography transformation and similarity transformation is used to correct,thus reducing the distortion of the non-overlapping region.The experimental results show that the proposed bi-directional image stitching method is more accurate than the one directional image stitching method,the average absolute error (MAE) of the corresponding points has a decline about 0.2,and the stitching result is more natural and smooth.

Key words: Grid vertex, Image alignment, Image stitching, Seam, Twist correction

CLC Number: 

  • TP391.41
[1]WANG J J,LIU J M,HU Y F,et al.Research and Development of Image Mosaics[J].Computer Science,2003,30(6):141-144.
[2]BROWN M,LOWE D G.Automatic panoramic image stitching using invariant features[J].International Journal of Computer Vision,2007,74(1):59-73.
[3]GAO J,KIM S J,BROWN M S.Constructing image panoramas using dual-homography warping[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Colorado Springs:IEEE Press,2011:49-56.
[4]LIN W Y,LIU S,MATSUSHITA Y,et al.Smoothly varying affine stitching[C]∥Proceedings of IEEE Conference on Compu-ter Vision and Pattern Recognition.Colorado Springs:IEEE Press,2011:345-352.
[5]ZARAGOZA J,CHIN T J,BROWN M S,et al.As-projective-as-possible image stitching with moving DLT[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Portland:IEEE Press,2013:2339-2346.
[6]CHANG C H,SATO Y,CHUANG Y Y.Shape-preserving half-projective warps for image stitching[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE Press,2014:3254-3261.
[7]LIN C C,PANKANTI S U,NATESAN RAMAMURTHY K,et al.Adaptive as-natural-as-possible image stitching[C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Boston:IEEE Press,2015:1155-1163.
[8]GUPTA R,AWASTHI D.WAVE—packet image fusion tech- nique based ongenetic algorithm[J].IEEE International Confe-rence on Confluence The Next Generation InformationTechno-logy Summit,2014,3(2):280-285.
[9]ZHU Z,LU J,WANG M,et al.A Comparative Study of Algorithms for Realtime Panoramic Video Blending[J].IEEE Tran-sactions on Image Processing,2018,27(6):2952-2965.
[10]WANG M,ZHU Z,ZHANG S,et al.Avoiding bleeding in image blending[C]∥2017 IEEE International Conference on Image Processing.Beijng:IEEE Press,2017:2139-2143.
[11]CHEN R,WANG J,HUANG H J,et a1.Multi-focus image fusion based on block DCT Transform[J].Journal of Chinese Computer Systems,2016,37(2):321-326.
[12]ZHANG X Q,TANG Z J,LUN J T.Image Stitching Based on Line Matching[J].Computer Science,2005,32(1):221-223.
[13]ZHANG F,LIU F.Parallax-tolerant image stitching[C]∥Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Columbus:IEEE Press,2014:3262-3269.
[14]LIN K,JIANG N,CHEONG L F,et al.Seagull:seam-guided local alignment for parallax-tolerant image stitching[C]∥Euro-pean Conference on Computer Vision.Amsterdam:IEEE Press,2016:370-385.
[15]SONG B S,FU Y Q,SONG H L.New Efficient Image Fusion Algorithm for Image Mosaic[J].Computer Science,2011,38(2):260-263.
[16]HARTLEY R,ZISSERMAN A.Multiple view geometry in computer vision[M].London:Cambridge university press,2003:75-89.
[17]FISCHLER M A,BOLLES R C.Random sample consensus:a paradigm for model fitting with applications to image analysis and automated cartography[J].Communications of the ACM,1981,24(6):381-395.
[18]GAO J,LI Y,CHIN T J,et al.Seam-Driven Image Stitching [C]∥Eurographics (Short Papers).Girona,2013:45-48.
[19]KWATRA V,SCHÖDL A,ESSA I,et al.Graphcut textures:image and video synthesis using graph cuts[J].ACM Transactions on Graphics (ToG),2003,22(3):277-286.
[20]PÉREZ P,GANGNET M,BLAKE A.Poisson image editing [J].ACM Transactions on graphics (TOG),2003,22(3):313-318.
[21]VEDALDI A,FULKERSON B.VLFeat:An open and portable library of computer vision algorithms[C]∥Proceedings of the 18th ACM International Conference on Multimedia.Firenze:ACM Press,2010:1469-1472.
[22]LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[1] JIN Li-zhen, LI Qing-zhong. Fast Structural Texture Image Synthesis Algorithm Based on Seam ConsistencyCriterion [J]. Computer Science, 2022, 49(6): 262-268.
[2] TIAN Yang, BI Xiu-li, XIAO Bin, LI Wei-sheng, MA Jian-feng. Image Seam Carving Tampering Detection by Discrete Tchebichef Transform [J]. Computer Science, 2021, 48(6A): 43-50.
[3] LU Jia-ming and ZHU Zhe. Real-time 4K Panoramic Video Stitching Based on GPU Acceleration [J]. Computer Science, 2017, 44(8): 18-21.
[4] AN Shi-quan, BAI Ling and QU Zhong. Lining Seam Elimination Algorithm in Tunnel Concrete Lining Based on Line Feature Unit Extraction [J]. Computer Science, 2017, 44(7): 304-308.
[5] QU Zhong and LI Xiu-li. Algorithm of Eliminating Image Stitching Line Based on Improved IGG Model [J]. Computer Science, 2017, 44(12): 274-278.
[6] QU Zhong, LIN Si-peng and JU Fang-rong. Improved Algorithm of Fast Image Stitching by Reducing Panoramic Distortion [J]. Computer Science, 2016, 43(5): 279-282.
[7] YANG Rui-da, XIA Shao-jie and TANG Yi-ping. Research on Key Technologies of 3D Fingerprint Based on Monocular Multi-view Machine Vision [J]. Computer Science, 2015, 42(Z6): 184-189.
[8] LIN Xiao, ZHANG Xiao-yu and MA Li-zhuang. Image Resizing Based on Seam Carving and Warping [J]. Computer Science, 2015, 42(9): 289-292.
[9] QU Zhong, QIAO Gao-yuan and LIN Si-peng. Fast Image Stitching Algorithm Eliminates Seam Line and Ghosting [J]. Computer Science, 2015, 42(3): 280-283.
[10] QIN Xu-jia, WANG Qi, WANG Hui-ling, ZHENG Hong-bo and CHEN Sheng-nan. Image Fusion Method Based on Best Seam-line for Serial Remote Sensing Images Mosaic [J]. Computer Science, 2015, 42(10): 306-310.
[11] LAO Bin,CHENG Jiu-jun,YAN Chun-gang. Study for the Streaming Media Application Based on Live Mesh of Cloud Computing [J]. Computer Science, 2010, 37(11): 92-96.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!