Computer Science

Computer Science ›› 2020, Vol. 47 ›› Issue (2): 76-82.doi: 10.11896/jsjkx.190500092

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Video Compression Algorithm Combining Frame Rate Up-conversion with HEVC Standard Based on Motion Vector Refinement

CAI Yu-han,XIONG Shu-hua,SUN Wei-heng,Karn PRADEEP,HE Xiao-hai   

  1. (College of Electronics and Information Engineering,Sichuan University,Chengdu 610065,China)
  • Received:2019-05-17 Online:2020-02-15 Published:2020-03-18
  • About author:CAI Yu-han,born in 1995,postgra-duate,is not member of China Compu-ter Federation.His main research in-terests include image/video coding and so on;XIONG Shu-hua,born in 1969,Ph.D,associate professor,master supervisor.Her main research interests include multimedia communication and signal processing and image processing.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61871279, 61471248)and Chengdu Industrial Cluster Collaborative Innovation Project (2016-XT00-00015-GX).

PDF (PC)

1178

Abstract: Combining frame rate conversion technology with the HEVC standard will improve the compression efficiency of video.Aiming at the non-ideal result in frame rate up-conversion using the motion vector of low frame rate video extracted from HEVC coding bit stream directly,this paper proposed a compression algorithm combining frame rate up-conversion and HEVC based on motion vector refinement.Firstly,at the encoding end,the original even frames are extracted to reduce the frame rate of video,and then the low frame rate video is encoded and decoded by HEVC.Combined with the motion vector extracted from HEVC coding bit stream at the decoding end,the forward-backward joint motion estimation is used to further refine it,which makes the motion vector closer to the real motion of the object.Finally,the frame rate up conversion technique based on motion compensation is used to restore the video to its original frame rate.Experimental results show that compared with the HEVC standard,the proposed algorithm has some bitrate saving.In the meantime,compared with other algorithms,the proposed algorithm can increase the PSNR value of reconstructed videos by 0.5 dB on average with the same bitrate saving.

Key words: Frame rate up-conversion, High efficiency video coding(HEVC), Joint motion estimation, Refinement of motion vector

CLC Number: 

  • TN919.81
[1]SULLIVAN G J,OHM J,HAN W J,et al.Overview of the high efficiency video coding (HEVC) standard[J].IEEE Transac-tions on Circuits & Systems for Video Technology,2012,22(12):1649-1668.
[2]FEGHALI R,SPERANZA F,WANG D,et al.Video quality metric for bitrate control via joint adjustment of quantiza-tion and frame rate[J].IEEE Transactions on Broadcasting,2007,53(1):441-446.
[3]KANG S J,YOO S,KIM Y H.Dual motion estimation for frame rate up-conversion [J].IEEE Transactions on Circuits & Systems for Video Technology,2010,20(12):1909-1914.
[4]LIU H,XIONG R,ZHAO D,et al.Multiple hypotheses Bayesian frame rate up-conversion by adaptive fusion of motion compensated interpolations [J].IEEE Transactions on Circuits & Systems for Video Technology,2012,22(8):1188-1198.
[5]WU Q D,HE X H,LIN H W,et al.Novel video compression coding algorithm combining frame rate conversion and HEVC standard [J].Acta Automatica Sinica,2018,44(9):1626-1636.
[6]CHOI B D,HAN J W,KIM C S,et al.Motion-compensated frame interpolation using bilateral motion estimation and adaptive overlapped block motion compensation[J].IEEE Transactions on Circuits & Systems for Video Technology,2007,17(4):407-416.
[7]KIM D,LIM H,PARK H.Iterative true motion estimation for motion compensated frame interpolatio[J].IEEE Transactions on Circuits & Systems for Video Technology,2013,23(3):445-454.
[8]DIKBAS S,ALTUNBASAK Y.Noveltrue-motion estimation algorithm and its application to motion-compensated temporal frame interpolation[J].IEEE Transactions on Image Proces-sing,2013,22(8):2931-2945.
[9]KIM U S,SUNWOO M H.New frame rate up-conversion algorithms with low compu tational complexity[J].IEEE Transactions on Circuits & Systems for Video Technology,2014,24(3):384-393.
[10]LEE W H,CHOI K,RA J B.Frame rate up-conversion based on variational image fusion[J].IEEE Transactions on Image Processing,2014,23(1):399-412.
[11]LU G,ZHANG X,CHEN L,et al.A novel frame rate up conversion using iterative non-local means interpolation [C]∥2017 IEEE International Symposiumon Broadband Multimedia Systems and Broadcasting.IEEE,2017:1-5.
[12]XU C.Frame rate up-conversion with true motion estimation and adaptive motion vector refinement[C]∥International Congress on Image & Signal Processing.IEEE,2011:15-17.
[13]HE J,YANG G,SONG J,et al.Hierarchi-cal prediction-based motion vector refinement for video frame-rate up-conversion[J].Journal of Real-Time Image Processing,2018,16(60):1-15.
[14]GUORIUI C.Frame rate up conversion algorithm based on adaptive agent motion compensation combined with semantic feature analysis[J].Journal of Ambient Intelligence and Huma-nized Computing,2018,10(54):1-8.
[15]GUO D,LU Z.Motion compensated frame interpolation with weighted motion estimation and hierarchical vector refinement[J].Neurocomputing,2016,18(1):76-85.
[16]ZHU W,SHANG M J,RONG Y,et al.Shot Boundary Detection MethodBased on HEVC Compressed Domain[J].Computer Scie-nce,2019,46(2):271-278.
[17]DE H G,BIEZEN P W A C,HUI J H,et al.True-motion estimation with 3-D recursive search block matching[J].IEEE Transactions on Circuits and Systems for Video Technology,1993,3(5):368-379.
[18]BOSSEN F.Common HM Test Conditions and Software Refe-rence Configurations[C]∥Proceedings of the 12th JCTVC Mee-ting.JCTVC,2013:1-3.
[1] LIU Dong, WANG Ye-fei, LIN Jian-ping, MA Hai-chuan, YANG Run-yu. Advances in End-to-End Optimized Image Compression Technologies [J]. Computer Science, 2021, 48(3): 1-8.
[2] ZHANG Jing-jing, ZHANG Ai-hua, JI Hai-feng. Image Compression Encoding Based on Wavelet Transform and Fractal [J]. Computer Science, 2019, 46(8): 310-314.
[3] XU Jing-yao, WANG Zu-lin, XU Mai. Deep Learning Based Fast VideoTranscoding Algorithm [J]. Computer Science, 2019, 46(3): 113-118.
[4] HENG Yang, CHEN Feng, XU Jian-feng, TANG Min. Application Status and Development Trends of Cardiac Magnetic Resonance Fast Imaging Based on Compressed Sensing Theory [J]. Computer Science, 2019, 46(1): 36-44.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.