Computer Science ›› 2022, Vol. 49 ›› Issue (11A): 210800195-8.doi: 10.11896/jsjkx.210800195

• Image Processing & Multimedia Technology • Previous Articles     Next Articles

Using Image Stabilization and VIBE Algorithm to Extract Foreground Target from Jitter Video

LIU Xin-fu, JIANG Mu-rong, HUANG Ya-qun, ZHANG Zhan-wei, ZHOU Ying-ying   

  1. School of Information Science & Engineering,Yunnan University,Kunming 650091,China
  • Online:2022-11-10 Published:2022-11-21
  • About author:LIU Xin-fu,born in 1995,postgraduate.His main research interests include image proces-sing,artificial intelligence and machine learning.
    JIANG Mu-rong,born in 1963,professor.Her main research interests include mathematical method of image proces-sing and its intelligent calculation.
  • Supported by:
    University Science and Technology Innovation Team Support Project of Yunnan Province,China(IRTSTYN19N07).

Abstract: In target detection and tracking processing area,the extracted foreground target is often disturbed by background jittering,resulting the problems of target misjudgment,incomplete contour and so on.In this paper,we present a method to improve the integrity of foreground target extraction by combining image stabilization and frame supplement,and then using VIBE algorithm and connected domain correction.Firstly,the image of two adjacent frames is matched by ORB feature,and the wrong ma-tching points are eliminated by RANSAC method.Then,the image margin is adjusted with the moving target as the center,and the non-coincident parts are cropped and repaired.The offset mean value of two adjacent frames is calculated by statistical method to achieve the purpose of video image stabilization.Secondly,the dense optical flow method is used to calculate the displacement of two adjacent frames,and then the intermediate frame is generated by position remapping and supplemented to make the video sequence more smooth and stable.Thirdly,based on VIBE algorithm,morphological processing and connected domain correction are added,and Canny operator is combined for edge detection to increase the integrity of target contour.Finally,a video example is used to test and compare with the commonly used video target extraction algorithms.The precision and recall rates increase by at least 10%.The rates of FNR and PWC reduce by at least 15%.Experimental results show that the proposed method can effectively remove the influence of jitter in most dynamic backgrounds,and the integrity of the extracted target is high.

Key words: Target extraction, Jitter video, Image stabilization, Frame compensation, VIBE algorithm, Connected domain modification

CLC Number: 

  • TP391
[1]XIN Y X,SHI P F,XUE RY.Moving Object Detection Based on Region Extraction and Improved LBP Features[J].Computer Science,2021,48(7):233-237.
[2]RAJ R,RAJIV P,KUMAR P,et.al.Feature based video stabilization based on boosted HAAR Cascade and representative point matching algorithm[J].Image and Vision Computing,2020,101(1):1-8.
[3]WU H C,XIAO L,WEI Z H.Simultaneous Video Stabilization and Rolling Shutter Removal[J].IEEE transactions on image processing:a publication of the IEEE Signal Processing Society,2021,30:4637-4652.
[4]LIN S S,LE T N H,WU P Y,et al.Content-and-disparity-aware stereoscopic video stabilization[J].Multimedia Tools and Applications,2020,80(1):1545-1564.
[5]MOHAMMED A,FARUP I,YILDIRIM S,et al.Variational approach for capsule video frame interpolation[J].EURASIP Journal on Image and Video Processing,2018,30(1):1-13.
[6]ZHANG Q,JIANG F.Video interpolation algorithm based on deep learning[J].Intelligent Computer and Applications,2019,9(4):252-257,262.
[7]LIN C J,DENG W,TONG T,et al.Fuzzy video frame interpolation method based on deep voxel stream[J].Journal of Compu-ter Applications,2020,40(3):819-824.
[8]WANG T,WANG W,CUI Y H,et al.Improved ViBe algo-rithm based on color layout descriptor[J].Journal of Computer Applications,2020,40(3):812-818.
[9]HE L F,LIU Y L,ZHONG Y,et al.Video foreground targetextraction algorithm under complex background[J].Laser & Optoelectronics Progress,2020,57(16):160-166.
[10]JIN M,ZHANG J,HUANG T F,et al.Parameter adaptive de-shading foreground target detection algorithm[J].Journal of Huazhong University of Science and Technology(Natural Science Edition),2021,49(1):73-79.
[11]BARNICH O,VAN DROOGENBROECK M.ViBe:a powerful random technique to estimate the background in video sequences[C]//2009 IEEE International Conference on Acoustics,Speech and Signal Processing.IEEE,2009:945-948.
[12]XU H Y,ZHANG B,YANG S.An infrared image registration algorithm combined with FAST algorithm[J].Journal of Shen-yang Institute of Aeronautical Engineering,2017,34(5):57-62.
[13]YANG X Y,CHEN B.Feature matching optimization algorithm based on ORB detection[J].Journal of Computer Applications,2019,39(S2):81-84.
[14]DAI W H,LIU S C,ZHAO S,et al.Improved random sampling consensus algorithm using local pixel matching[J].Journal of National University of Defense Technology,2021,43(4):38-43.
[15]ZHANG L.Design and implementation of facial expression re-cognition system based on sparse optical flow method and HMM[D].Xiamen:Xiamen University,2019.
[16]LIN C Z,ZHANG W,WANG X,et al.Smoke detection algo-rithm based on dense optical flow and edge features[J].Computer Engineering and Science,2018,40(7):1213-1220.
[17]WANG X R,WANG X G.OpenCV and Visual Studio image recognition application development[M].Beijing:Posts& Telecom Press,2017:124-127.
[18]QIN X P.MATLAB image processing and interface programming[M].Beijing:Publishing House of Electronics Industry,2009:310-327,445-447.
[19]ZHOU Z H.Machine learning[M].Beijing:Tsinghua University Press,2016:30-32.
[1] ZHANG Wen-ya, XU Hua-zhong and LUO Jie. Moving Objects Detection under Complex Background Based on ViBe [J]. Computer Science, 2017, 44(9): 304-307.
[2] YI Meng and CHU Yan. Aerial Video Image Stabilization Based on Affine Invariant Constraint and Fast EKF Adaptive Filter [J]. Computer Science, 2016, 43(8): 313-317.
[3] WANG Hui and SONG Jian-xin. Threshold Based Adaptive Vibe Target Detection Algorithm [J]. Computer Science, 2015, 42(Z6): 154-157.
[4] JI Li-xia and LI Xue-xiang. Algorithm and Simulation of Image Stabilization for High Speed Moving Target Images Based on Adjacent Frames Compensation [J]. Computer Science, 2014, 41(7): 310-312.
[5] ZHOU Yu-bin,SHI Yong-gang. Real-time Electronic Digital Image Stabilization System Based on Multi-core Computation [J]. Computer Science, 2010, 37(4): 269-.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!