Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 230400081-8.doi: 10.11896/jsjkx.230400081

• Image Processing & Multimedia Technolog • Previous Articles     Next Articles

Fast Algorithm for Affine Motion Estimation Based on Statistical Analysis

ZHONG Yucheng1, HUANG Xiaofeng1, NIU Weihong1, CUI Yan2   

  1. 1 School of Communication Engineering,Hangzhou Dianzi University,Hangzhou 310018,China
    2 Zhejiang Economic Information Center,Hangzhou 310007,China
  • Published:2024-06-06
  • About author:ZHONG Yucheng,born in 2002,undergraduate.His main research interests include video processing and compression technology.
    CUI Yan,born in 1988,postgraduate.Her main research interests include image video coding and VLSI design.
  • Supported by:
    Technology Project Managed by State Grid Corporation of China Headquarter(5700-202325308A-1-1-ZN) .

Abstract: To reduce the computational complexity of the new generation video coding standard-versatile video coding(VVC),a fast affine motion estimation(AME) calculation method based on statistical analysis is proposed.In the proposed method,we first abandon the integer pixel and 1/16-pixel accuracy,while retaining 1/4-pixel accuracy of the three motion vector(MV) accuracies.Secondly,we build the relationship between the iterations and quantization parameters(QP),slice type,and coding unit(CU) size to obtain an adaptive formula for reducing the number of iterations in AME.Then,the four integer pixels in the four corners of CU in the fine granularity search(FGS) algorithm are replaced by two diagonal sub pixels.Finally,the sum of absolute transform difference(SATD) cost is used to replace the rate distortion optimization(RDO) cost.Experimental results show that compared with the H.266/VVC reference software VTM-10.0,the proposed algorithm saves 8.34% and 8.83% of time in low delay B(LDB) and random access(RA) configurations,while the performance loss is only 0.10% and 0.12%,respectively.

Key words: Versatile video coding, Affine motion estimation, Pixel accuracy, Fine granularity search, Sum of absolute transform difference

CLC Number: 

  • TN919
[1]WIEGAND T,SULLIVAN G J,BJONTEGAARD G,et al.Overview of the H.264/AVC video coding standard[J].IEEE Transactions on Circuits and Systems for Video Technology,2003,13(7):560-576.
[2]SULLIVAN G J,OHM J R,HAN W J,et al.Overview of the high efficiency video coding(HEVC) standard[J].IEEE Transactions on Circuits and Systems for Video Technology,2012,22(12):1649-1668.
[3]WIECKOWSKI A,MA J,SCHWARZ H,et al.Fast partitioning decision strategies for the upcoming versatile video coding(VVC) standard[C]//2019 IEEE International Conference on Image Processing(ICIP).IEEE,2019:4130-4134.
[4]TUN E E,ARAMVITH S,ONOYE T.Low complexity modeselection for H.266/VVC intra coding[J].ICT Express,2022,8(1):83-90.
[5]HUANG Y W,AN J,HUANG H,et al.Block partitioningstructure in the VVC standard[J].IEEE Transactions on Circuits and Systems for Video Technology,2021,31(10):3818-3833.
[6]PARK S H,KANG J W.Fast affine motion estimation for versatile video coding(VVC) encoding[J].IEEE Access,2019,7:158075-158084.
[7]CHOWDARY T A,NALLURI P.Multiple Transform Selection in Versatile Video Coding:a Review[C]//2022 8th International Conference on Advanced Computing and Communication Systems(ICACCS).IEEE,2022,1:991-996.
[8]BROSS B,WANG Y K,YE Y,et al.Overview of the versatile video coding(VVC) standard and its applications[J].IEEE Transactions on Circuits and Systems for Video Technology,2021,31(10):3736-3764.
[9]HOANGVAN X,NGUYENQUANG S,DINHBAOM,et al.Fast QTMT for H.266/VVC intra prediction using early-terminated hierarchical CNN model[C]//2021 International Conference on Advanced Technologies for Communications(ATC).IEEE,2021:195-200.
[10]WANG K,LIANG H,ZHANG S,et al.Fast CU PartitionMethod Based on Extra Trees for VVC Intra Coding[C]//2022 IEEE International Conference on Visual Communications and Image Processing(VCIP).IEEE,2022:1-5.
[11]WANG Z,WANG J,YANG J,et al.A Fast Transform Algorithm for VVC Intra Coding[C]//2022 11th International Conference on Communications,Circuits and Systems(ICCCAS).IEEE,2022:237-240.
[12]ZHANG Z,FU C H,XIE K,et al.Fast VVC Intra Coding bySkipping Redundant Coding Block Structures and Unnecessary Directional Partition[C]//2022 IEEE 5th International Conference on Multimedia Information Processing and Retrieval(MIPR).IEEE,2022:84-89.
[13]LIU C,SUN H,KATTO J,et al.QA-filter:A QP-adaptive convolutional neural network filter for video coding[J].IEEE Transactions on Image Processing,2022,31:3032-3045.
[14]PARK S H,KANG J W.Fast affine motion estimation for versatile video coding(VVC) encoding[J].IEEE Access,2019,7:158075-158084.
[15]GUAN X,SUN X.VVC Fast ME Algorithm Based on Spatial Texture Features and Time Correlation[C]//2021 International Conference on Digital Society and Intelligent Systems(DSInS).IEEE,2021:371-377.
[16]JUNG S,JUN D.Context-based inter mode decision method for fast affine prediction in versatile video coding[J].Electronics,2021,10(11):1243.
[17]DUARTE A,GONÇALVES P,AGOSTINI L,et al.Fast affine motion estimation for vvc using machine-learning-based early search termination[C]//2022 IEEE International Symposium on Circuits and Systems(ISCAS).IEEE,2022:1-5.
[18]ZHU S,MA K K.A new diamond search algorithm for fastblock-matching motion estimation[J].IEEE Transactions on Image Processing,2000,9(2):287-290.
[19]ZHU C,LIN X,CHAU L P.Hexagon-based search pattern for fast block motion estimation[J].IEEE Transactions on Circuits and Systems for Video Technology,2002,12(5):349-355.
[20]TOURAPIS A M.Enhanced predictive zonal search for single and multiple frame motion estimation[C]//Visual Communications and Image Processing 2002.SPIE,2002,4671:1069-1079.
[21]PURNACHAND N,ALVES L N,NAVARRO A.Improve-ments to TZ search motion estimation algorithm for multiview video coding[C]//2012 19th International Conference on Systems,Signals and Image Processing(IWSSIP).IEEE,2012:388-391.
[22]ZHANG K,CHEN Y W,ZHANG L,et al.An improved framework of affine motion compensation in video coding[J].IEEE Transactions on Image Processing,2018,28(3):1456-1469.
[23]LI L,LI H,LIU D,et al.An efficient four-parameter affine motion model for video coding[J].IEEE Transactions on Circuits and Systems for Video Technology,2017,28(8):1934-1948.
[24]CHEN J,YE Y,KIM S.Algorithm description for versatile video coding and test model 10(VTM 10) JVET-S2002[C]//19th Meeting of the Joint Video Exploration Team(JVET).2020:1-67.
[25]BOYCE J,SUEHRING K,LI X,et al.JVET-J1010:JVET common test conditions and software reference configurations[C]//10th Meeting of the Joint Video Experts Team.2018:JVET-J1010-v1.
[26]BJONTEGAARD G.Calculation of average PSNR differences between RD-curves(VCEG-M33)[Z].2001.
[1] ZHU Li, HAN Huimei, ZHAI Wenchao. Design of QPSK Intelligent Receiver Based on LSTM Neural Network [J]. Computer Science, 2023, 50(11A): 230200219-5.
[2] LIU Xingguang, ZHOU Li, ZHANG Xiaoying, CHEN Haitao, ZHAO Haitao, WEI Jibo. Edge Intelligent Sensing Based UAV Space Trajectory Planning Method [J]. Computer Science, 2023, 50(9): 311-317.
[3] WU Liuchen, ZHANG Hui, LIU Jiaxuan, ZHAO Chenyang. Defect Detection of Transmission Line Bolt Based on Region Attention Mechanism andMulti-scale Feature Fusion [J]. Computer Science, 2023, 50(6A): 220200096-7.
[4] YANG Si-xing, LI Ning, GUO Yan, YANG Yan-yu. Intelligent Jammers Localization Scheme Under Sensor Sleep-Wakeup Mechanism [J]. Computer Science, 2022, 49(11A): 211000165-6.
[5] JIANG Sheng-teng, ZHANG Yi-chi, LUO Peng, LIU Yue-ling, CAO Kuo, ZHAO Hai-tao, WEI Ji-bo. Analysis of Performance Metrics of Semantic Communication Systems [J]. Computer Science, 2022, 49(7): 236-241.
[6] LI Fa-guang, YILIHAMU·Yaermaimaiti. Real-time Detection Model of Insulator Defect Based on Improved CenterNet [J]. Computer Science, 2022, 49(5): 84-91.
[7] HE Quan-qi, YU Fei-hong. Review of Low Power Architecture for Wireless Network Cameras [J]. Computer Science, 2021, 48(6A): 369-373.
[8] WANG Deng-tian, ZHOU Hua, QIAN He-yue. LDPC Adaptive Minimum Sum Decoding Algorithm and Its FPGA Implementation [J]. Computer Science, 2021, 48(6A): 608-612.
[9] XU Yi-fei, XIONG Shu-hua, SUN Wei-heng, HE Xiao-hai, CHEN Hong-gang. HEVC Post-processing Algorithm Based on Non-local Low-rank and Adaptive Quantization Constraint Prior [J]. Computer Science, 2021, 48(5): 155-162.
[10] LIU Dong, WANG Ye-fei, LIN Jian-ping, MA Hai-chuan, YANG Run-yu. Advances in End-to-End Optimized Image Compression Technologies [J]. Computer Science, 2021, 48(3): 1-8.
[11] TIAN Wei, LIU Hao, CHEN Gen-long, GONG Xiao-hui. Cross Subset-guided Adaptive Measurement for Block Compressive Sensing [J]. Computer Science, 2020, 47(12): 190-196.
[12] CAI Yu-han,XIONG Shu-hua,SUN Wei-heng,Karn PRADEEP,HE Xiao-hai. Video Compression Algorithm Combining Frame Rate Up-conversion with HEVC Standard Based on Motion Vector Refinement [J]. Computer Science, 2020, 47(2): 76-82.
[13] HE Chao, XIE Zhi-dong, TIAN Chang. Dynamic Resource Allocation for UAV Video Uploading [J]. Computer Science, 2019, 46(11): 88-93.
[14] WANG Shu-yun, GAN Zong-liang, LIU Feng. Face Hallucination Reconstruction Algorithm Based on Hierarchical Clustering Regression Model [J]. Computer Science, 2019, 46(8): 298-302.
[15] ZHANG Jing-jing, ZHANG Ai-hua, JI Hai-feng. Image Compression Encoding Based on Wavelet Transform and Fractal [J]. Computer Science, 2019, 46(8): 310-314.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!