计算机科学 ›› 2017, Vol. 44 ›› Issue (2): 296-301.doi: 10.11896/j.issn.1002-137X.2017.02.050

• 图形图像与模式识别 • 上一篇    下一篇

PMVS算法的CPU多线程和GPU两级粒度并行策略

刘金硕,江庄毅,徐亚渤,邓娟,章岚昕   

  1. 武汉大学计算机学院 武汉430072,武汉大学计算机学院 武汉430072,武汉大学计算机学院 武汉430072,武汉大学国际软件学院 武汉430072,武汉大学计算机学院 武汉430072
  • 出版日期:2018-11-13 发布日期:2018-11-13
  • 基金资助:
    本文受国家自然科学基金(61303214,61672393)资助

Multithread and GPU Parallel Schema on Patch-based Multi-view Stereo Algorithm

LIU Jin-shuo, JIANG Zhuang-yi, XU Ya-bo, DENG Juan and ZHANG Lan-xin   

  • Online:2018-11-13 Published:2018-11-13

摘要: PMVS(Patch-based Multi-View Stereo)三维重建算法被广泛应用于无人机航拍影像的三维场景重建中。针对PMVS三维重建算法计算量大、时间复杂度高的问题,提出了PMVS算法的CPU多线程和GPU两级粒度并行策略(Multithread and GPU Parallel Schema,MGPS),方法具体包括:基于GPU的PMVS算法特征提取和片面扩散的并行设计;多影像的GPU和CPU任务分配机制,以使得部分任务分配给CPU采用多线程并行,部分任务分配给GPU并行时,程序总运行时间最短。实验采用搭载24核CPU和NVIDIA Tesla K20 GPU的高性能服务器作为测试平台,针对分辨率为4081×2993的16幅无人机影像进行三维重建。实验结果表明,相比串行的PMVS算法,基于MGPS的PMVS算法取得4倍左右的加速比,其中特征提取最高加速13倍,计算误差在10%以内,该方法实现了更高效的PMVS三维重建。基于MGPS的PMVS算法还可用于文物保护、医学图像处理、虚拟现实等领域。

关键词: MGPS,基于GPU的片面扩散,图像分配策略,PMVS,三维重建

Abstract: PMVS (Patch-based Multi-view Stereo) has been widely used in the 3D reconstruction,with the aerial photo of the UAV (Unmanned Aerial Vehicle).To solve the problem of the time complexity and calculation amount of PMVS,this paper proposed the two-level parallel schema of CPU multi-thread and GPU for PMVS.The solution includes GPU-based parallel design and optimization and task allocation mechanism of the images between the GPU and CPU.The experiments have been done on the platform with a 24-core CPU and NVIDIA Tesla K20 GPU high-performance server,with 16 remote sensing images having the resolution of 4081×2993.Compared with the serial traditional PMVS,the experiment results show that our model MGPS (the two-level parallel schema of CPU multi-thread and GPU for PMVS) can be 13 times faster at feature extraction,4 times faster at PMVS.Calculation error is less than 10%.MGPS shortens the execution time of PMVS algorithm.PMVS based on MGPS algorithm can also be used in the field of cultural relic protection,medical image processing,virtual reality and so on.

Key words: Multithread and GPU parallel schema(MGPS),GPU-based patch expansion,Image allocation strategy,Patch-based multi-view stereo (PMVS),3D-reconstruction

[1] SHU B,QIU X J,WANG Z Q.Survey of shape from image[J].Journal of Computer Research and Development,2010,7(3):549-560.(in Chinese) 束搏,邱显杰,王兆其.基于图像的几何建模技术综述[J].计算机研究与发展,2010,47(3):549-560.
[2] XIE Z.UAV aerial image-based three-dimensional reconstruc-tion of outdoor scenes[D] .Hangzhou:Zhejiang University of Technology,2014.(in Chinese) 谢榛.基于无人机航拍图像的室外场景三维重建技术研究[D].杭州:浙江工业大学,2014.
[3] FURUKAWA Y,ACCURATE P J.Dense,and Robust Multi-view Stereopsis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2009,32(8):1362-1376.
[4] SEITZ S M,CURLESS B,DIEBEL J,et al.A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms[C]∥Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington:IEEE Computer Society,2006:519-528.
[5] YU M,QI F F,YU Y,et al.3D reconstruction algorithm based on multi-view stereo[J].Computer Engineering and Design,2013,4(2):730-733.(in Chinese) 于明,齐菲菲,于洋,等.基于立体视觉的三维重建算法[J].计算机工程与设计,2013,4(2):730-733.
[6] SHI L M,GUO F S,HU Z Y.An Improved PMVS through Scene Geometric Information[J].ACTA Automatica Sinica, 2011,7(5):560-568.(in Chinese) 史利民,郭复胜,胡占义.利用空间几何信息的改进PMVS算法[J].自动化学报,2011,37(5):560-568.
[7] ZHU Q.The study and realization of multi-view image-based 3D reconstruction algorithm [D].Lanzhou:Lanzhou University,2009.(in Chinese) 朱芹.基于多视点图像的三维重构算法的研究及实现[D].兰州:兰州大学,2009.
[8] FURUKAWA Y,CURLESS B,SEITZ S M,et al.Towards Internet-scale multi-view stereo[C]∥IEEE Conference on Computer Vision & Pattern Recognition.2010:1434-1441.
[9] XIAO X W,GUO B X,LI D R,et al.Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle Imagery[J].Remote Sensing,2016,8(2):89-119.
[10] HUI Z,XIE Y,HENG P A.Accelerating feature extraction for patch-based Multi-View Stereo algorithm[C]∥2010 International Conference on Computer Design and Applications (ICCDA).IEEE,2010:V5-511-V5-515.
[11] XIAO H.Research on high efficiency heterogeneous parallelcomputing based on CPU+GPU in image matching [D].Wuhan:Wuhan University,2011.(in Chinese) 肖汉.基于CPU+GPU的影像匹配高效能异构并行计算研究[D].武汉:武汉大学,2011.
[12] ZHANG L,ZHAO Y,HOU K.The Research of Levenberg-Marquardt Algorithm in Curve Fittings on Multiple GPUs[C]∥2011 IEEE 10th International Conference on Trust,Security and Privacy in Computing and Communications (TrustCom).IEEE,2011:1355-1360.
[13] XIANG Z,DIANWEN Z.Efficient parallel Levenberg-Mar-quardt model fitting towards real-time automated parametric ima-ging microscopy[J].Plos One,2013,8(10):e76665-e76665.

No related articles found!
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!