Computer Science ›› 2017, Vol. 44 ›› Issue (2): 296-301.doi: 10.11896/j.issn.1002-137X.2017.02.050

Previous Articles     Next Articles

Multithread and GPU Parallel Schema on Patch-based Multi-view Stereo Algorithm

LIU Jin-shuo, JIANG Zhuang-yi, XU Ya-bo, DENG Juan and ZHANG Lan-xin   

  • Online:2018-11-13 Published:2018-11-13

Abstract: PMVS (Patch-based Multi-view Stereo) has been widely used in the 3D reconstruction,with the aerial photo of the UAV (Unmanned Aerial Vehicle).To solve the problem of the time complexity and calculation amount of PMVS,this paper proposed the two-level parallel schema of CPU multi-thread and GPU for PMVS.The solution includes GPU-based parallel design and optimization and task allocation mechanism of the images between the GPU and CPU.The experiments have been done on the platform with a 24-core CPU and NVIDIA Tesla K20 GPU high-performance server,with 16 remote sensing images having the resolution of 4081×2993.Compared with the serial traditional PMVS,the experiment results show that our model MGPS (the two-level parallel schema of CPU multi-thread and GPU for PMVS) can be 13 times faster at feature extraction,4 times faster at PMVS.Calculation error is less than 10%.MGPS shortens the execution time of PMVS algorithm.PMVS based on MGPS algorithm can also be used in the field of cultural relic protection,medical image processing,virtual reality and so on.

Key words: Multithread and GPU parallel schema(MGPS),GPU-based patch expansion,Image allocation strategy,Patch-based multi-view stereo (PMVS),3D-reconstruction

[1] SHU B,QIU X J,WANG Z Q.Survey of shape from image[J].Journal of Computer Research and Development,2010,7(3):549-560.(in Chinese) 束搏,邱显杰,王兆其.基于图像的几何建模技术综述[J].计算机研究与发展,2010,47(3):549-560.
[2] XIE Z.UAV aerial image-based three-dimensional reconstruc-tion of outdoor scenes[D] .Hangzhou:Zhejiang University of Technology,2014.(in Chinese) 谢榛.基于无人机航拍图像的室外场景三维重建技术研究[D].杭州:浙江工业大学,2014.
[3] FURUKAWA Y,ACCURATE P J.Dense,and Robust Multi-view Stereopsis[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2009,32(8):1362-1376.
[4] SEITZ S M,CURLESS B,DIEBEL J,et al.A Comparison and Evaluation of Multi-View Stereo Reconstruction Algorithms[C]∥Proceedings of the 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition.Washington:IEEE Computer Society,2006:519-528.
[5] YU M,QI F F,YU Y,et al.3D reconstruction algorithm based on multi-view stereo[J].Computer Engineering and Design,2013,4(2):730-733.(in Chinese) 于明,齐菲菲,于洋,等.基于立体视觉的三维重建算法[J].计算机工程与设计,2013,4(2):730-733.
[6] SHI L M,GUO F S,HU Z Y.An Improved PMVS through Scene Geometric Information[J].ACTA Automatica Sinica, 2011,7(5):560-568.(in Chinese) 史利民,郭复胜,胡占义.利用空间几何信息的改进PMVS算法[J].自动化学报,2011,37(5):560-568.
[7] ZHU Q.The study and realization of multi-view image-based 3D reconstruction algorithm [D].Lanzhou:Lanzhou University,2009.(in Chinese) 朱芹.基于多视点图像的三维重构算法的研究及实现[D].兰州:兰州大学,2009.
[8] FURUKAWA Y,CURLESS B,SEITZ S M,et al.Towards Internet-scale multi-view stereo[C]∥IEEE Conference on Computer Vision & Pattern Recognition.2010:1434-1441.
[9] XIAO X W,GUO B X,LI D R,et al.Multi-View Stereo Matching Based on Self-Adaptive Patch and Image Grouping for Multiple Unmanned Aerial Vehicle Imagery[J].Remote Sensing,2016,8(2):89-119.
[10] HUI Z,XIE Y,HENG P A.Accelerating feature extraction for patch-based Multi-View Stereo algorithm[C]∥2010 International Conference on Computer Design and Applications (ICCDA).IEEE,2010:V5-511-V5-515.
[11] XIAO H.Research on high efficiency heterogeneous parallelcomputing based on CPU+GPU in image matching [D].Wuhan:Wuhan University,2011.(in Chinese) 肖汉.基于CPU+GPU的影像匹配高效能异构并行计算研究[D].武汉:武汉大学,2011.
[12] ZHANG L,ZHAO Y,HOU K.The Research of Levenberg-Marquardt Algorithm in Curve Fittings on Multiple GPUs[C]∥2011 IEEE 10th International Conference on Trust,Security and Privacy in Computing and Communications (TrustCom).IEEE,2011:1355-1360.
[13] XIANG Z,DIANWEN Z.Efficient parallel Levenberg-Mar-quardt model fitting towards real-time automated parametric ima-ging microscopy[J].Plos One,2013,8(10):e76665-e76665.

No related articles found!
Full text



No Suggested Reading articles found!