计算机科学 ›› 2023, Vol. 50 ›› Issue (11A): 221100153-8.doi: 10.11896/jsjkx.221100153

• 图像处理&多媒体技术 • 上一篇    下一篇

基于网格与超像素的图像重定向方法

陈美颖, 毕秀丽, 刘波   

  1. 重庆邮电大学图像认知重庆市重点实验室 重庆 400065
  • 发布日期:2023-11-09
  • 通讯作者: 毕秀丽(bixl@cqupt.edu.cn)
  • 作者简介:(chenmy0712@163.com)

Image Retargeting Method Based on Grids and Superpixels

CHEN Meiying, BI Xiuli, LIU Bo   

  1. Chongqing Key Laboratory of Image Cognition,Chongqing University of Posts and Telecommunications,Chongqing 400065,China
  • Published:2023-11-09
  • About author:CHEN Meiying,born in 2001,bachelor.Her main research interest isimage processing.
    BI Xiuli,born in 1982,Ph.D,associate professor,Ph.D supervisor,is a member of China Computer Federation.Her main research interests include image processing and multimedia information security.

摘要: 图像是人与人之间进行交流的重要媒介,在信息高速发展的今天,利用图像重定向技术使图像能满足各式各样的设备尺寸具有重要意义。基于网格的图像重定向算法首先对输入图像生成对应的规则矩形网格,然后根据该网格内的图像内容来评估图像像素权重以此决定此网格的变形程度,对图像全局进行不断迭代直到图像重定向终止条件。此类算法仍存在对图像内容评估不全面的问题,进而导致输出图像结构扭曲、难以保持结果图像的对角线特征以及整体结构等问题。针对以上问题,提出了一种基于超像素、梯度以及显著性的图像重定向方法。首先利用超像素方法对输入图像做预处理,然后用超像素块作为后续处理单位,随后利用基于梯度和显著性的图像像素权重评估方法对超像素处理输出图像进行权重度量,输出一幅图像重定向权重热力图,最后根据此重定向权重热力图对网格进行迭代优化,实现对图像的重定向处理。实验结果表明,相比对比方法所提方法在6种无参考图像质量评估指标上都有一定优越性,在语义合理性、信息准确性和视觉自然性上都具有一定优势,在图像重定向领域有较大的应用价值。

关键词: 图像处理, 图像重定向, 图像显著性检测, 超像素

Abstract: Image is an important medium for communication between people.With the rapid development of information today,it is of great significance using image retargeting technology to make images adaptto a variety of device sizes.The grid-based image retargeting algorithm first generates a regular rectangular grid corresponding to the input image,and then determines the defor-mation degree of the grid by evaluating the weight of image pixels according to the image content in the grid.The global iteration of the image is carried out until the termination condition of image retargeting.However,such algorithms still have the problem of incomplete evaluation of image content,which leads to the distortion of the output image structure,and it is difficult to maintain the diagonal features and overall structure of the result image.In order to solve the above problems,this paper proposes an image retargeting method based on superpixels,gradients and saliency.Firstly,the input image is preprocessed by the superpixel me-thod,and then the superpixel block is used as the subsequent processing unit,and the image pixel weight evaluation method based on gradient and saliency is used to measure the weight of the superpixel output image,and an image retargeting weight heat map is output.Finally,the grid is iteratively optimized according to the retargeting weight heat map and realize the retargeting of the image.Experimental results show that the proposed method has certain advantages in the six no-reference image quality assessment indicators,and has certain advantages in semantic rationality,information accuracy and visual naturalness,and has great application value in the field of image retargeting.

Key words: Image processing, Image retargeting, Image significance detection, Superpixels

中图分类号: 

  • TP751
[1]SHAMIR A S,TOG A J.Seam carving for content-aware image resizing[J].ACM Trans.Graph.,2007,26:1-10.
[2]PRITCH Y,KAV-VENAKI E,PELEG S.Shift-Map Image Edi-ting[C]//2009 IEEE 12th International Conference on Compu-ter Vision.2009.
[3]WOLF L,GUTTMANN M,COHEN-OR D.Non-homogeneous Content-driven Video-retargeting[C]//IEEE International Conference on Computer Vision.2007.
[4]KRAEHENBUEHL P,LANG M,HORNUNG A,et al.A system for retargeting of streaming video[J].ACM SIGGRAPH Asia 2009 Papers,2009,28(5):1-10.
[5]WANG Y S,TAI C L,SORKINE O,et al.Optimized Scale-and-Stretch for Image Resizing[J].ACM SIGGRAPH Asia 2008 Papers,2008,27(5):118.
[6]ITTI L,KOCH C,NIEBUR E.A model of saliency-based vi-sual attention for rapid scene analysis[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1998,20(11):1254-1259.
[7]ACHANTA R,ESTRADA F,WILS P,et al.Salient Region Detection and Segmentation[C]//Computer Vision Systems(ICVS 2008).2008.
[8]ACHANTA R,HEMAMI S F,ESTRADA† F,et al.IEEE[J].Requency-tuned salient region detection,2009.
[9]ZHAI Y,SHAH M.Visual attention detection in video se-quences using spatiotemporal cues[C]//Proceedings of the 14th ACM International Conference on Multimedia.Santa Barbara,CA,USA,2006:23-27.
[10]CHENG M,MITRA N J,HUANG X,et al.Global ContrastBased Salient Region Detection[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,37(3):569-582.
[11]ACHANTA R,SHAJI A,SMITH K,et al.SLIC superpixelscompared to state-of-the-art superpixel methods[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2012,34(11):2274-2282.
[12]PETERSON L E.K-nearest neighbor[J].Scholarpedia,2009,4(2):1883.
[13]RUBINSTEIN M,GUTIERREZ D,SORKINE O,et al.A comparative study of image retargeting[J].ACM Transactions on Graphics(TOG),2010,(6):1-10.
[14]ARBELAEZ P,MAIRE M,FOWLKES C,et al.Machine Intelligence[J].Contour Detection and Hierarchical Image Segmentation,2011,33(5):898-916.
[15]ZHOU Y,CHEN Z,LI W,et al.Weakly Supervised Reinforced Multi-Operator Image Retargeting[J].IEEE Transactions on Circuits and Systems for Video Technology,2020,31(1):126-139.
[16]SIMAKOV D,CASPI Y,SHECHTMAN E,et al.Summarizing visual data using bidirectional similarity[C]//IEEE Conference on Computer Vision and Pattern Recognition(CVPR 2008).2008.
[17]ZHANG T,YU M,GUO Y,et al.Content-Aware Retargeted Image Quality Assessment[J].Information,2019,10(3):111.
[18]MOORTHY A K,BOVIK A C.A Two-Step Framework forConstructing BlindImage Quality Indices[J].IEEE Signal Processing Letters,2010,17(5):513-516.
[19]SAAD M A,BOVIK A C,CHARRIER C.Blind image quality assessment:A natural scene statistics approach in the DCT domain[J].IEEE Transactions on Image Processing,2012,21(8):3339-3352.
[20]LIU L,LIU B,HUANG H,et al.No-reference Image Quality Assessment Based on Spatial and Spectral Entropies[J].Signal Processing Image Communicaton,2014,29(8):856-863.
[21]FERZLI R,KARAM L J.A no-reference objective image sharpness metric based on the notion of just noticeable blur(JNB)[J].IEEE Transactions on Image Processing,2009,18(4):717-728.
[22]GUAN J,ZHANG W,GU J,et al.No-reference blur assessment based on edge modeling[J].Journal of Visual Communication and Image Representation,2015,29:1-7.
[23]NARVEKAR N D,KARAM L J.A no-reference perceptualimage sharpness metric based on a cumulative probability of blur detection[C]//International Workshop on Quality of Multimedia Experience.2009.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!