计算机科学 ›› 2017, Vol. 44 ›› Issue (8): 18-21.doi: 10.11896/j.issn.1002-137X.2017.08.003

• 2016 中国计算机图形学会议 • 上一篇    下一篇

基于GPU加速的实时4K全景视频拼接

卢嘉铭,朱哲   

  1. 清华大学计算机科学与技术系 北京100084,清华大学计算机科学与技术系 北京100084
  • 出版日期:2018-11-13 发布日期:2018-11-13

Real-time 4K Panoramic Video Stitching Based on GPU Acceleration

LU Jia-ming and ZHU Zhe   

  • Online:2018-11-13 Published:2018-11-13

摘要: 虚拟现实是近年来热门的新技术,而全景视频摄制是生产虚拟现实内容的一种重要方式。介绍了一个全景视频拼接系统,其能够对六路的2K视频实时进行拼接,生成4K的输出视频。设计了一个并行化的拼接流程,对整个拼接过程中的不同步骤都进行了并行化处理,并在GPU上进行了实现。实验结果表明,该系统能够实时拼接出高质量的4K全景视频。

关键词: 图像拼接,图像融合,GPU加速

Abstract: Virtual reality is a popular technique in recent years,and panoramic video capture is an important way of producing the content of virtual reality.In this paper,we proposed a practical system that can stitch 4K panoramic video in real time.The inputs of our system are 6 candidate videos with 2K resolution,and output is a 4K stitched video.With the parallelization of the whole procedure,we can efficiently implement the whole system in GPU.Experimental results show that our system can produce high-quality 4K panoramic video.

Key words: Image stitching,Image blending,GPU acceleration

[1] SZELISKI R.Image alignment and stitching:A tutorial[J].Foundatons & Trends in Computer Graphics & Vision,2004,2(1):1-104.
[2] PEREZ P,GANGNET M,BLAKE A.Poisson image editing[J].ACM Transactions on Graphics,2003,22(3):313-318.
[3] AGARWALA A.Efficient gradient-domain compositing usingquadtrees[J].ACM Transactions on Graphics,2007,26(3):94.
[4] FARBMAN Z,HOER G,LIPMAN Y,et al.Coordinates for instant image cloning[J].ACM Transactions on Graphics,2009,28(3):67.
[5] BURT P J,ADELSON E H.A multiresolution spline with application to image mosaics[J].ACM Transactions on Graphics,1983,2(4):217-236.
[6] SZELISKI R,UYTTENDAELE M,STEEDLY D.Fast poisson blending using multi-splines[C]∥International Conference on Computational Photography (ICCP 11).IEEE,2011:1-8.
[7] JIA J,SUN J,TANG C K,et al.Drag-and-drop pasting[J].ACM Transactions on Graphics,2006,5(3):631-637.
[8] TAO M W,JOHNSON M K,PARIS S.Error-tolerant image compositing[J].International Journal of Computer Vision,2013,103(2):178-189.
[9] ZHU Z,HUANG H Z,TAN Z P,et al.Faithful Completion of Images of Scenic Landmarks Using Internet Images[J].IEEE Transactions on Visualization and Computer Graphics,2015,22(8):1945-1958.
[10] ZHU Z,MARTIN R,HU S M.Panorama Completion for Street Views[J].Computational Visual Media,2015,1(1):49-57.
[11] CHEN T,ZHU Z,SHARMI A,et al.3-Sweep:Extracting Edi-table Objects from a Single Photo[J].ACM Transactions on Graphics (TOG),Siggraph Asia,2013,32(6):1-10.
[12] BATRA V,KILGARD M,KUMAR H,et al.Accelerating Vector Graphics Rendering using the Graphics Hardware Pipeline[J].ACM Trans.on Graph.,2015,34(4):146.
[13] LOOP C,BLINN J.Resolution independent curve renderingusing programmable graphics hardware[J].ACM Trans.on Graph.,2005,24(3):1000-1009.
[14] HUANG M C,LIU F ,WU E H.A GPU-based matting Laplacian solver for high resolution image matting[J].The Visual Computer,2010,6(6):943-950.
[15] ZHU Z,LU J M,ZHANG S H,et al.A Comparative Study of Blending Algorithms for Realtime Panoramic Video Stitching[J].arXiv preprint,arXiv:1606.00103,6.
[16] IRANI M,ANANDAN P.About direct methods[C]∥International Workshop on Vision Algorithms.Springer,Kerkyra,Greece,1999:267-277.
[17] BROWN M,SZELISKI R,WINDER S.Multi-imagematchingusingmulti-scale oriented patches[C]∥IEEE Conference on Compu-ter Vision and Pattern Recognition (CVPR’2005).2005:510-517.
[18] ZHU Z,MARTIN R R,PEPPERELL R,et al.3D Modeling and Motion Parallax for Improved Video Conferencing[J].Computational Visual Media,2016,2(2):131-142.
[19] LOWE D G.Distinctive image features from scale-invariant keypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[20] MATAS J,CHUM O,URBAN M,et al.Robust wide baseline stereo from maximally stable extremal regions[J].Image and Vision Computing,2004,22(10):761-767.
[21] KWATRA V,SCHDL A,ESSA I,et al.Graphcut textures:image and video synthesis using graph cuts[J].ACM Trans.on Graph.,2003,22(3):277-286.
[22] ALSUWAIYEL M,GAVRILOVA M.On the Distance Trans-form of Binary Images[J].Methods in Molecurlar Biology,2000,9(4):87-102.
[23] PERAZZI F,SORKINE-HORNUNG A,ZIMMER H,et al.Panoramic Video from Unstructured Camera Arrays[C]∥ Computer Graphics Forum (Proceedings of Eurographics 2015).2015:57-68.
[24] LIN K,LIU S,CHEONG L,et al.Seamless Video Stitching with Hand-held Camera Inputs[J].Computer Graphics Forum,2016,35(2):479-487.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!