Computer Science

Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 441-446.doi: 10.11896/jsjkx.210600043

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Acceleration Algorithm of Multi-channel Video Image Stitching Based on CUDA Kernel Function

LIU Yun1, DONG Shou-jie2   

  1. 1 Nanjing Les Information Technology Co.,Ltd,Nanjing 210001,China
    2 North China Air Traffic Administration of Civil Aviation of China,Beijing 100710,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:LIU Yun,born in 1991,postgraduate,intermediate engineer.Her main inte-rests include video image processing and moving target recognition algorithm.

PDF (PC)

854

Abstract: With the rapid growth of the number of general airports and the rapid development of remote towers,multi-channel real-time video stitching technology is constantly improved.Most of the video mosaic algorithms are based on the improvement of feature point extraction algorithm,feature point matching algorithm and image fusion algorithm.The improved feature point extraction algorithm makes the feature points more accurate.The improved image fusion algorithm makes the color of each image on the panorama consistent and eliminates the stitching seam.Finally,the GPU is used to accelerate the process.This paper focuses on the overall calculation process of image mosaic,from the mathematical point of view to calculate the pixel coordinate transformation matrix and pixel value transformation matrix from the original image to panoramic image.In video stitching,based on the pixel coordinate transformation matrix of pixel value transformation matrix,the kernel function is used to calculate the coordinates and pixel values after matrix transformation.Set the thread configuration when the kernel function is called.The parallel computing ability of the graphics processor is fully utilized to accelerate the image stitching.The experimental results show that the stitching time of 8-channel 1080 * 1920 videos is about 22 ms.The core technology of video stitching includes streaming,decoding,stitching,coding and transmission.At the end of the paper,some suggestions on streaming and decoding technology are put forward.

Key words: Compute unified device architecture, Graphic Processing Unit, Kernel function, Matrix transformation, Video stitching

CLC Number: 

  • TP399
[1] Civil Aviation Administration of China.Strategic Conception of Building a Powerful Civil Aviation Country[Z].Baijing,2010.
[2] HE H,HE X.Analysis on the Influence of General Airport on County Economic Development[J].Science Technology and Industry,2020,20(12):154-159.
[3] KRAISS K,KUHLEN T.Virtual reality:principles and applications.From sensors to situstion awareness[C]//DLR-Mitteilung.Koln DLR,1996:96-112.
[4] CHEN D Q,LI T T,GUO X,et al.Improved SIFT neighborhood Voting image matching algorithm[J].Computer Enginee-ring and Design,2020,41(1):162-168.
[5] GUO X,YANG J,LIN H.Image registration method based on improved SIFT algorithm and essential matrix estimation[C]//IEEE International Conference on Information & Automation.Macau:IEEE,2017:814-819.
[6] HYUN B J,JAE E J.Feature-point extraction based on an in-proved SIFT algorithm[C]//International Conference on Control,Automation an Systems.Jeju:IEEE,2017:345-350.
[7] ZHOU Z W,YUAN F W,ZHANG K,et al.Image Matching Method Combining SURF and FLANN Algorithm[J].Intelligent Computer and Applications,2019,9(6):160-163,167.
[8] TANG Y F,WANG Z J,ZHANG Z X.Registration of SandDune Images Using an Improved SIFT and SURF Algorithm[J].Journal of Tsinghua University(Science and Technology),2021,61(2):161-169.
[9] DI G H,SU F L,YANG H X,et al.ISAR image scattering center association based on speeded-up robust features[J].Multimedia Tools and Applications,2020,79(9):5065-5082.
[10] ZHANG L T,HUANG X L,LU L L,et al.An Improved Harris Corner Detection Algorithm Based on Similar Pixels[J].Science of Surveying and Mapping,2019,44(7):111-115.
[11] WANG L,ZHOU X Z,YAN H.Real-time SIFT AlgorithmBased on GPU[J].Computer Science,2020,47(8):105-111.
[12] YANG Z F,YAN L.Technologies of Image Mosaic Based onImproved SURF Algorithm[J].Journal of Wuhan Institute of Technology,2021,43(2):223-226,231.
[13] MACHADO L,MATTHEW T,JIE L,et al.Nonrigid registration of 3D ultrasound for neurosurgery using automatic feature detection and matching[J].International Journal of Computer Assisted Radiology and Surgery,2018,13(10):1525-1538.
[14] KOU Q Q,CHENG D Q,ZHUANG H D,et al.Cross-complementary local binary pattern for robust texture classication[J].IEEE Signal Processing Letters,2019,26(1):129-133.
[15] LI Y F,LI G Z,GU S H,et al.Image mosaic algorithm based on area blocking and SIFT[J].Optics and Precision Engineering,2016,24(5):1197-1205.
[16] CHEN X.An Algorithm Development Environment for Problem-Solving[C]//International Conference on Computational Problem-Solving.IEEE,2010:85-90.
[17] WANG J L,ZHOU Z F.Image Matching Algorithm Based on SIFT Feature Extraction and FLANN Search[J].Computer Measurement and Control,2018,26(2):175-178.
[18] SHAO J D,YANG S,CHEN L.UAV Image Matching Algorithm Based on Improved SIFT Algorithm and Two-stage Feature Matching[J].Computer Science,2019,46(6):316-321.
[19] ZHANG M Y,WANG Y Y,HOU X H,et al.Image Stitching Algorithm Based on ORB and Improved RANSAC[J].Computer Science,2019,46(S2):294-298.
[20] LI X G,REN C,ZHANG T X,et al.Unmanned Aerial Vehicle Image Matching Based on Improved RANSAC Algorithm and SURF Algorithm[J].The International Archives of the Photogrammetry,Remote Sensing and Spatial Information Sciences,2020:67-70.
[21] QU Z,QIAO G Y,LIN S P.A Fast Image Stitching Algorithm Eliminates Seam Line and Ghosting[J].Computer Science,2015,42(3):280-283.
[22] QU Z,LI X L.Algorithm of Eliminating Image Stitching LineBased on Improved IGG Model[J].Computer Science,2017,44(12):274-278.
[23] CHENG Y F.The Algorithm of Fast Image Mosaic Based on Stitching Seam Elimination and Panorama Alignment[D].Chongqing:Chongqing University of Posts and Telecommunications,2020.
[24] XU S Y.Research on Image Processing Algorithms for 4K Ultra HD Endoscopes Based on CUDA[D].Zhejiang:Zhejiang University,2020.
[25] WANG Z,ZHANG B K,WANG J,et al.CUDA-Based Seamless Stitching Method for Multi-Camera Real-Time HD Video[J].Computer Applications and Software,2016,33(2):123-128.
[26] LI X.Research On Lane Detection Algorithm Based On CUDA Acceleration[D].Dalian:Dalian University of Technology,2020.
[27] WANG Y K,LIU R,WEN T X,et al.GPU Acceleration for Kernel Regression Algorithm of Three-Dimensional Medical Image[J].Chinese Journal of Medical Physics,2018,35(12):1417-1425.
[28] YU M H,WANG S T,LI Y C,et al.Distortion AlgorithmOpenCL Parallel Acceleration[J].Remote Sensing Information,2019,34(3):88-92.
[1] LI Fan, YAN Xing, ZHANG Xiao-yu. Optimization of GPU-based Eigenface Algorithm [J]. Computer Science, 2021, 48(4): 197-204.
[2] YANG Si-yan,HE Guo-qi,LIU Ru-yi. Video Stitching Algorithm Based on SIFT and Its Optimization [J]. Computer Science, 2019, 46(7): 286-291.
[3] ZHANG Shan-wen, WEN Guo-qiu, ZHANG Le-yuan, LI Jia-ye. Sparse Feature Selection Algorithm Based on Kernel Function [J]. Computer Science, 2019, 46(2): 62-67.
[4] ZHU Chao, WU Su-ping. Parallel Harris Feature Point Detection Algorithm [J]. Computer Science, 2019, 46(11A): 289-293.
[5] CHEN Jun-fen, ZHANG Ming, HE Qiang. Heuristically Determining Cluster Numbers Based NJW Spectral Clustering Algorithm [J]. Computer Science, 2018, 45(11A): 474-479.
[6] CHEN Peng, ZHANG Jian-wei. Image Denoising Method Combining Kernel Function and Nonlinear Partial Differential Equation [J]. Computer Science, 2018, 45(11): 278-282.
[7] SUN Han-bo and FENG Guo-can. Spam Filter Algorithm with Improved Porter Stemmer and Kernels Methods [J]. Computer Science, 2017, 44(Z6): 61-67.
[8] YE Qiu-ping and ZHANG Hong-ying. Fuzzy Rough Sets Based on New Kernel Functions [J]. Computer Science, 2017, 44(9): 70-73.
[9] MENG Zhi-qing, MA Ke and ZHENG Ying. Forecasting Method for Fashion Clothing Demand Based on Kernel Functions Technology [J]. Computer Science, 2016, 43(Z11): 455-460.
[10] ZHANG Jing, XIONG Cheng-yi and GAO Zhi-rong. Implementation for Compressed Sensing Reconstruction Algorithm Based on GPU [J]. Computer Science, 2016, 43(8): 318-322.
[11] GAN Ling, ZOU Kuan-zhong and LIU Xiao. Pedestrian Detection Based on PCA Dimension Reduction of Multi-feature Cascade [J]. Computer Science, 2016, 43(6): 308-311.
[12] XU Jie, LIANG Jiu-zhen, WU Qin and LI Min. Kernel Canonical Correlation Analysis Feature Fusion Method and Application [J]. Computer Science, 2016, 43(1): 35-39.
[13] HAN Lei, XU Bo, HUANG Xiang-sheng and ZHANG Yan-feng. Speckle Projection Systems Based on GPU [J]. Computer Science, 2015, 42(8): 294-299.
[14] HU Yan-su, GAO Ang, WANG Zhi-jun and MU De-jun. GPU Application on the Phase-field Simulation [J]. Computer Science, 2015, 42(7): 19-21.
[15] TIAN Hao-bing, ZHU Jia-gang and LU Xiao. WFCD-based Rough Set One-class Support Vector Machine [J]. Computer Science, 2015, 42(6): 239-242.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.