Computer Science ›› 2020, Vol. 47 ›› Issue (11): 192-198.doi: 10.11896/jsjkx.191000101

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Content-aware Image Retargeting Algorithm Based on Explicit SURF Feature Preservation

ZHAO Liang, PENG Hong-jing, DU Zhen-long   

  1. School of Computer Science and Technology,Nanjing University of Technology,Nanjing 211816,China
  • Received:2019-10-16 Revised:2020-03-17 Online:2020-11-15 Published:2020-11-05
  • About author:ZHAO Liang,born in 1994,postgra-duate.His main research interests include image processing and computer vision.
    PENG Hong-jing,born in 1965,Ph.D,associate professor,is a member of China Computer Federation.His research interests include pattern recognition and computer vision,data mining and machine learning.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61672279).

Abstract: Image retargeting is a digital media processing technique that adjusts the image size to fit the target resolution of any display device aspect ratio.Most of the existing research on image retargeting focuses on the shape preservation of important objects,while the key features of images are sensitive to the human visual system are not fully considered,resulting in lower visual acceptance.Therefore,a new image retargeting algorithm based on explicit SURF feature preservation is proposed.Different from the general mesh deformation technology based on vertex or axis alignment,the mesh deformation technique based on mesh edge is adopted.First,an affine matrix is defined,so that each mesh edge is deformed according to the affine matrix to form a basic mesh edge-based deformation model.Then,the SURF feature region is obtained by SURF feature detection,and the mesh edge range is constrained to the SURF feature region to achieve the feature preservation effect.Thereby,a new mesh deformation mo-del is obtained.In addition,a sparse energy term is set on the basis of the basic mesh deformation model,that is,assigning initial weights to each mesh edge to make the grid lines sparse each other,thereby solving the problem of grid line self-intersection.This weight can also be updated during the iterative solution process if necessary.Finally,an image quality assessment is performed between the proposed method and two existing image retargeting methods.The proposed method can minimize the distortion and produce better visual effects during the image retargeting process.The highest score gain can reach 16.0% and 9.7%,respectively.

Key words: 2D mesh deformation, Content-aware image retargeting, Image quality assessment, Image warping method, SURF feature preservation

CLC Number: 

  • TP391
[1] AVIDAN S,SHAMIR A.Seam carving for content-aware image resizing[J].ACM Transactions on Graphics,2007,26(3):10.
[2] RUBINSTEIN M,SHAMIR A,AVIDAN S.Improved seamcarving for video retargeting[J].ACM Transactions on Gra-phics,2008,27(3):1.
[3] HWANG D S,CHIEN S Y.Content-aware image resizing using perceptual seam carving with human attention model[C]//IEEE International Conference on Multimedia & Expo.IEEE,2008.
[4] CHOI J,KIM C.Sparse Seam-Carving for Structure Preserving Image Retargeting[J].Journal of Signal Processing Systems,2015,85(2):1-9.
[5] BATTIATO S,FARINELLA G M,PUGLISI G,et al.Saliency-Based Selection of Gradient Vector Flow Paths for Content Aware Image Resizing[J].IEEE Transactions on Image Proces-sing,2014,23(5):2081-2095.
[6] WANG Y S,TAI C L,SORKINE O,et al.Optimized scale-and-stretch for image resizing[C]//Acm Siggraph Asia.2008:118.
[7] GUO Y,LIU F,SHI J,et al.Image Retargeting Using Mesh Parametrization[J].IEEE Transactions on Multimedia,2009,11(5):856-867.
[8] ZHANG G X,CHENG M M,HU S M,et al.A Shape-Preserving Approach to Image Resizing[J].Computer Graphics Forum,2009,28(7):1897-1906.
[9] ZHOU B,WANG X,CAO S,et al.Optimal bi-directional seam carving for compressibility-aware image retargeting[J].Journal of Visual Communication and Image Representation,2016,41(NOV.):21-30.
[10] LIN S S,YEH I C,LIN C H,et al.Patch-Based Image Warping for Content-Aware Retargeting[J].IEEE Transactions on Multimedia,2013,15(2):359-368.
[11] CHANG C H,CHUANG Y Y.A Line-Structure-PreservingApproach to Image Resizing[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE,2012.
[12] PANOZZO D,WEBER O,SORKINE O.Robust Image Retar-geting via Axisâ-Aligned Deformation[J].Computer Graphics Forum,2012,31(2pt1):229-236.
[13] CHOI S,HAM B,SOHN K.Fast image retargeting via axis-aligned importance scaling[C]//2013 IEEE International Conference on Image Processing.IEEE,2014.
[14] DAS B C,GOPALAKRISHNAN V,IYER K N,et al.Similarity and rigidity preserving image retargeting[C]//2016 IEEE International Conference on Image Processing (ICIP).IEEE,2016.
[15] KIM Y,JUNG S,JUNG C,et al.A structure-aware axis-aligned grid deformation approach for robust image retargeting[J].Multimedia Tools and Applications,2018,77(6):7717-7739.
[16] HUA S,CHEN G,WEI H,et al.Similarity measure for image resizing using SIFT feature[J].EURASIP Journal on Image and Video Processing,2012,2012(1):6.
[17] BAY H,ESS A,TUYTELAARS T,et al.Speeded-Up Robust Features (SURF)[J].Computer Vision and Image Understan-ding,2008,110(3):346-359.
[18] LOWE D G.Distinctive Image Features from Scale-InvariantKeypoints[J].International Journal of Computer Vision,2004,60(2):91-110.
[19] UMEYAMA S.Least-squares estimation of transformation parameters between two point patterns[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1991,13(4):376-380.
[20] RUBINSTEIN M,GUTIERREZ D,SORKINE O,et al.A Comparative Study of Image Retargeting[J].ACM Transactions on Graphics,2010,29(6):160.
[21] LIU Y J,LUO X,XUAN Y M,et al.Image Retargeting Quality Assessment[J].Computer Graphics Forum,2011,30(2):583-592.
[1] LU Ting, HOU Guo-jia, PAN Zhen-kuan, WANG Guo-dong. Underwater Image Quality Assessment Based on HVS [J]. Computer Science, 2022, 49(5): 98-104.
[2] YANG Xiao-qin, LIU Guo-jun, GUO Jian-hui, MA Wen-tao. Full Reference Color Image Quality Assessment Method Based on Spatial and Frequency Domain Joint Features with Random Forest [J]. Computer Science, 2021, 48(8): 99-105.
[3] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
[4] LI Kai-wen, XU Lin, CHEN Qiang. Relative Image Quality Assessment Based on CPNet [J]. Computer Science, 2020, 47(11): 159-167.
[5] YANG Yun-shuo, SANG Qing-bing. No-reference Color Noise Images Quality Assessment Without Learning [J]. Computer Science, 2020, 47(10): 161-168.
[6] QU Xing-xing, ZHANG Fan, LIU Bin and ZHANG Ruo-ya. Survey on Image Inverse Halftoning and its Quality Evaluation [J]. Computer Science, 2016, 43(Z6): 109-115.
[7] XIONG Run-sheng, LI Chao-feng and ZHANG Wei. No-reference Stereoscopic Image Quality Assessment Based on Wavelet Transform [J]. Computer Science, 2015, 42(9): 282-284.
[8] HUA Dong and YU Hong-sheng. Digital Fusion Image Quality Objective Assessment Method Based on Visual Information Fidelity [J]. Computer Science, 2014, 41(Z6): 224-226.
[9] SANG Qing-bing,LIANG Di-lin,WU Xiao-jun and LI Chao-feng. Gradient Structural Similarity Image Assessment Index Based on Dilation [J]. Computer Science, 2014, 41(6): 287-290.
[10] CHU Jiang and CHEN Qiang. Research on Natural Scene Statistics in Color Space [J]. Computer Science, 2014, 41(11): 309-312.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!