计算机科学 ›› 2019, Vol. 46 ›› Issue (3): 92-96.doi: 10.11896/j.issn.1002-137X.2019.03.012

• 2018 中国多媒体大会 • 上一篇    下一篇

一种融合深度基于灰度共生矩阵的感知模型

叶鹏,王永芳,夏雨蒙,安平   

  1. (上海大学上海先进通信与数据科学研究院 上海 200444)
    (上海大学通信与信息工程学院 上海 200444)
  • 收稿日期:2018-07-11 修回日期:2018-09-21 出版日期:2019-03-15 发布日期:2019-03-22
  • 通讯作者: 王永芳女,博士,副教授,CCF会员,主要研究领域为智能视觉处理、3D视频编码与重建,E-mail:yfw@shu.edu.cn
  • 作者简介:叶鹏男,硕士生,主要研究领域为图像/视频感知模型及视频编码,E-mail:1639998780@qq.com;王永芳女,博士,副教授,CCF会员,主要研究领域为智能视觉处理、3D视频编码与重建,E-mail:yfw@shu.edu.cn(通信作者);夏雨蒙女,硕士生,主要研究领域为图像/视频质量评估;安平女,教授,主要研究领域为3D视频编码与重建、光场编码与重建。
  • 基金资助:
    国家自然科学基金:QoE驱动下的基于内容分析的3D视频感知编码研究(61671283),国家自然科学基金:面向高清/超高清的感知3D视频稀疏编码理论与技术研究(61301113)资助

Perceptual Model Based on GLCM Combined with Depth

YE Peng, WANG Yong-fang, XIA Yu-meng, AN Ping   

  1. (Shanghai Institute for Advanced Communication and Data Science,Shanghai University,Shanghai 200444,China)
    (School of Communication and Information Engineering,Shanghai University,Shanghai 200444,China)
  • Received:2018-07-11 Revised:2018-09-21 Online:2019-03-15 Published:2019-03-22

摘要: 恰可察觉失真模型(JND)是一种人眼感知模型,它是图像/视频压缩中去除冗余最为有效的方法之一。针对现有JND模型对比掩盖效应(CM)的计算不够完善及深度信息的考虑不够准确的问题,文中提出了一种融合深度基于灰度共生矩阵的JND模型。首先,采用总变分分解模型将图像分解为结构部分和纹理部分,对结构部分采用Canny算子处理,对纹理部分采用灰度共生矩阵处理,两个部分形成更准确的CM模型;结合背景亮度掩盖效应,建立了一种基于灰度共生矩阵的像素域JND模型。然后,在对人眼深度感知进行研究的基础上,引入新的深度加权模型。最后,建立了一种新的融合深度基于灰度共生矩阵的感知模型。实验结果表明,所提出的模型更一致于人的视觉感知。相对于已有的JND模型,所提JND模型能够容忍更多的失真,且拥有更好的感知质量。

关键词: CM模型, JND模型, 灰度共生矩阵, 深度信息, 图像分解

Abstract: Just Noticeable Distortion (JND) model is a kind of perceptual model,which is one of the most effective methods to remove the visual redundancy in image/video compression.Because the calculation of the contrast masking effect (CM) is not perfect and the consideration of depth information is not accurate in the existing JND model,this paper proposed a JND model combined with depth based on gray level co-occurrence matrix (GLCM).Firstly,the image is decomposed into the edge part and the texture part by the total variance(TV) method,the edge part is processed by Canny operator and the texture part is processed by GLCM.A more accurate CM model is formed by incorporating above two parts.Further,a new JND model based on gray-level co-occurrence Matrix is established by combining the background brightness masking effect.Besides,based on the human depth perception,a novel depth weighting model is proposed.Finally,a new perceptual model combined with depth based on GLCM is established.The experimental results show that the proposed model is more consistent with the human visual perception.Comparing with the existing JND model,the proposed model can tolerate more distortion and has much better perceptual quality.

Key words: Contrast masking model, Depth information, Gray-level co-occurrence matrix(GLCM), Image decomposition, Just noticeable distortion model

中图分类号: 

  • TP37
[1]WANG Y F,ZHU K H,WU J,et al.Asymmetric perceptual video coding system and method based on just noticeable distortion model:CN 106331707 A[P].2017-01-11.
[2]LIU J,WANG Y F,WU C F,et al.Improved JND model and its application in image coding[J].Video Engineering,2011,35(13):15-18.(in Chinese)
刘静,王永芳,武翠芳,等.改进的JND模型及其在图像编码中的应用[J].电视技术,2011,35(13):15-18.
[3]BOUCHAKOUR M,JEANNIC G,AUTRUSSEAU F.JND
mask adaptation for wavelet domain watermarking[C]∥IEEE International Conference on Multimedia and Expo.IEEE,2010:201-204.
[4]LIN W,DONG L,XUE P.Visual distortion gauge based on discrimination of noticeable contrast changes.[J].IEEE Transactions on Circuits & Systems for Video Technology,2005,15(7):900-909.
[5]YANG X K,LING W S,LU Z K,et al.Just noticeable distortion modeland its applications in video coding[J].Signal Processing Image Communication,2005,20(7):662-680.
[6]LEGGE G E,FOLEY J M.Contrast masking in human vision
[J].Journal of the Optical Society of America,1980,70(12):1458-1471.
[7]CHOU C H,LI Y C.A perceptually tuned subband image coder based on the measure of just-noticeable-distortion profile[J].IEEE Transactions on Circuits & Systems for Video Technology,1995,5(6):467-476.
[8]LIU A,LIN W,PAUL M,et al.Just Noticeable Difference for Images With Decomposition Model for Separating Edge and Textured Regions[J].IEEE Transactions on Circuits & Systems for Video Technology,2010,20(11):1648-1652.
[9]WU J,LIN W,SHI G,et al.Pattern masking estimation in ima-
ge with structuraluncertainty[J].IEEE Transactions on Image Processing A Publication of the IEEE Signal Processing Society,2013,22(12):4892-4904.
[10]SILVA D V S X D,FERNANDO W A C,NUR G,et al.3D video
assessment with Just Noticeable Difference in Depth evaluation[C]∥IEEE International Conference on Image Processing.IEEE,2010:4013-4016.
[11]ZHANG H W.Multiple description coding of three-dimensional depth images[D].Beijing:Beijing Jiaotong University,2016.(in Chinese)
张慧雯.三维深度图像的多描述编码[D].北京:北京交通大学,2016.
[12]YIN W,GOLDFARB D,OSHER S.A comparison of three total variation based texture extraction models[J].Journal of Visual Communication and Image Representation,2007,18(3):240-252.
[13]HARALICK R M,SHANMUGAM K,DINSTEIN I.Textural
Features for Image Classification[J].IEEE Transactions on Systems Man & Cybernetics,1973,SMC-3(6):610-621.
[14]WANG H M,SHI P.Image texture feature extraction method[J].Journal of Communication University of China Science and Technology,2006,13(1):49-52.(in Chinese)
王惠明,史萍.图像纹理特征的提取方法[J].中国传媒大学学报(自然科学版),2006,13(1):49-52.
[15]BO H,MA F L,JIAO L C.Analysis of image grayscale co-occurrence matrix computation problems [J].Acta Electronica Sinica,2006,34(1):155-158.(in Chinese)
薄华,马缚龙,焦李成.图像纹理的灰度共生矩阵计算问题的分析[J].电子学报,2006,34(1):155-158.
[16]FRISTON K.The free-energy principle:A unified brain theory?[J].Nature Reviews Neuroscience,2010,11(2):127.
[17]ECKERT M P,BRADLEY A P.Perceptual quality metrics applied to still image compression[J].Signal Processing,1998,70(3):177-200.
[18]KANG X,HAN C,YANG Y,et al.SAR Image Edge Detection by Ratio-based Harris Method[C]∥IEEE InternationalCon-ference on Acoustics,Speech and Signal Processing(ICASSP 2006).IEEE,2006:2.
[19]YANG X,LIN W,LU Z,et al.Motion-compensated residue preprocessing in video coding based on just-noticeable-distortion profile[J].IEEE Transactions on Circuits & Systems for Video Technology,2005,15(6):742-752.
[20]FEHN C.Depth-image-based rendering (DIBR),compression,
and transmission for a new approach on 3D-TV[J].Proc Spie,2004,5291:93-104.
[21]CHENG H,ZHANG J,WU Q,et al.Stereoscopic visual saliency prediction based on stereo contrast and stereo focus[J].Eurasip Journal on Image & Video Processing,2017,2017(1):61.
[22]OTSU N.A Threshold Selection Method from Gray-Level Histograms[J].IEEE Transactions on Systems Man &Cyberne-tics,1979,9(1):62-66.
[23]International Telecommunicaton Union.ITU-R BT:500-11:
Methodology for the Subjective Assessment of the Quality of Television Pictures (Geneva,2002)[OL].http://www.itu.int/rec/R-REC-BT.500/en.
[24]HORE A,ZIOU D.Image Quality Metrics:PSNR vs. SSIM[C]∥
International Conference on Pattern Recognition.IEEE,2010:2366-2369.
[1] 郑波, 马昕.
基于双变异粒子群优化算法优化的支持向量机及其在民航发动机损伤类型识别中的应用
Application on Damage Types Recognition in Civil Aeroengine Based on SVM Optimized by DMPSO
计算机科学, 2020, 47(11A): 132-138. https://doi.org/10.11896/jsjkx.200600101
[2] 蒋贤维, 张妙娴, 朱兆松.
基于灰度共生矩阵和精度高斯支持向量机的中国手语手指语识别
Recognition of Chinese Finger Sign Language Based on Gray Level Co-occurrence Matrix and Fine Gaussian Support Vector Machine
计算机科学, 2019, 46(11A): 303-308.
[3] 杜秀丽, 张薇, 顾斌斌, 陈波, 邱少明.
基于灰度共生矩阵的图像自适应分块压缩感知方法
GLCM-based Adaptive Block Compressed Sensing Method for Image
计算机科学, 2018, 45(8): 277-282. https://doi.org/10.11896/j.issn.1002-137X.2018.08.050
[4] 陈甜甜, 姚璜, 左明章, 田元, 杨梦婷.
基于深度信息的动态手势识别综述
Review of Dynamic Gesture Recognition Based on Depth Information
计算机科学, 2018, 45(12): 42-51. https://doi.org/10.11896/j.issn.1002-137X.2018.12.006
[5] 邹娜, 田金文.
多特征融合红外舰船尾流检测方法研究
Research on Multi Feature Fusion Infrared Ship Wake Detection
计算机科学, 2018, 45(11A): 172-175.
[6] 苏慧嘉,郑继明.
结合游程长度与共生矩阵的图像拼接篡改检测方法
Image Splicing Blind Detection Method Combined RLRN with GLCM
计算机科学, 2017, 44(6): 150-154. https://doi.org/10.11896/j.issn.1002-137X.2017.06.025
[7] 李文莉,高宏伟,冀大雄,李岩.
基于遗传算法的海底沉积物纹理特征优化方法
Optimization Method of Seabed Sediment Texture Feature Based on Genetic Algorithm
计算机科学, 2016, 43(Z6): 130-133. https://doi.org/10.11896/j.issn.1002-137X.2016.6A.031
[8] 吴杰,朱家明,陈静.
基于模糊聚类水平集的医学图像分割方法
Fuzzy Clustering Level Set Based Medical Image Segmentation Method
计算机科学, 2015, 42(Z11): 155-159.
[9] 张永良,刘超凡,肖刚,方珊珊.
基于曲波纹理分析和SVM-KNN分类的假指纹检测算法
Fake Fingerprint Detection Algorithm Based on Curvelet Texture Analysis and SVM-KNN Classification
计算机科学, 2014, 41(12): 303-308. https://doi.org/10.11896/j.issn.1002-137X.2014.12.065
[10] 王娴,周宇,云挺,邓玉和.
基于Curvelet变换的荻草细胞图像分割
Miscanthus Sacchariflorus Cells Image Segmentation Based on Curvelet Transformation
计算机科学, 2012, 39(11): 277-279.
[11] 韩智,刘昌平.
基于多种特征融合的指纹识别方法
Fingerprint Recognition Method Based on Multi-feature Fusion
计算机科学, 2010, 37(7): 255-259.
[12] 苑丽红,孙爽滋,付丽.
灰度共生矩阵检索纹理图像的算法研究
Study on Algorithm of Texture Image Retrival by Gray Level Co-occurrence Matrix
计算机科学, 2009, 36(11): 300-303.
[13] 刘广海 郭克华 杨静宇.
基于RGB向量空间的彩色纹理图像检索

计算机科学, 2007, 34(8): 242-244.
[14] .
一种快速的SAR图像分类方法

计算机科学, 2007, 34(5): 222-223.
[15] 苗启广 王宝树.
基于小波变换与局部能量的多聚焦图像融合

计算机科学, 2005, 32(2): 229-232.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!