计算机科学 ›› 2021, Vol. 48 ›› Issue (8): 99-105.doi: 10.11896/jsjkx.200700106

• 计算机图形学& 多媒体 • 上一篇    下一篇

基于随机森林的空域-频域联合特征全参考彩色图像质量评价方法

杨小琴, 刘国军, 郭建慧, 马文涛   

  1. 宁夏大学数学统计学院 银川750021
  • 收稿日期:2020-07-16 修回日期:2020-09-03 发布日期:2021-08-10
  • 通讯作者: 刘国军(liugj@nxu.edu.cn)
  • 基金资助:
    宁夏自然科学基金(2018AAC03014);国家自然科学基金(61461043,51769026);宁夏回族自治区重点研发项目(2019BEG03056);宁夏大学研究生创新项目(GIP2019011)

Full Reference Color Image Quality Assessment Method Based on Spatial and Frequency Domain Joint Features with Random Forest

YANG Xiao-qin, LIU Guo-jun, GUO Jian-hui, MA Wen-tao   

  1. School of Mathematics and Statistics,Ningxia University,Yinchuan 750021,China
  • Received:2020-07-16 Revised:2020-09-03 Published:2021-08-10
  • About author:YANG Xiao-qin,born in 1996,postgra-duate.Her main research interests include image quality assessment and machine learning.(yxq258351@163.com)LIU Guo-jun,born in 1978,Ph.D,professor,Ph.D supervisor,master tutor.His main research interests include wavelet and partial differential equations for image processing,image quality assessment,and machine learning.
  • Supported by:
    Natural Science Foundation of Ningxia(2018AAC03014),National Natural Science Foundation of China(61461043,51769026),Key Research and Development Projects of Ningxia(2019BEG03056) and Graduate Innovation Project of Ningxia University(GIP2019011).

摘要: 文中旨在设计一种可以自动评估图像质量,并达到与人类视觉系统相一致的客观评价算法。针对大多数传统的全参考图像质量评价方法只在空域中分析图像,并且在池策略上存在不足,文中提出了一种基于随机森林的空域-频域联合特征全参考彩色图像质量评价方法。该方法首先在空域上提取色度和梯度特征,刻画图像的颜色信息和空间结构信息;在频域上提取log-Gabor滤波器组响应后的纹理细节信息以及空间频率特征,将二者作为联合特征;然后利用随机森林学习特征向量与主观意见得分之间的映射关系,预测客观质量得分。在TID2013,TID2008和CSIQ 3个标准数据库上的实验结果表明,所提方法的综合评价性能优于目前主流的全参考评价算法,尤其是在TID2013数据库上其皮尔逊线性相关系数值达到了0.9397。

关键词: 空域, 频域, 全参考图像质量评价, 随机森林

Abstract: This paper is to design an objective evaluation algorithm that automatically evaluates image quality and is consistent with the human visual system.In view of the fact that most traditional full reference image quality assessment methods only analyze images in the spatial domain,and have shortcomings in pooling strategies,this paper proposes a random forest based spatial-frequency domain joint feature full reference color image quality evaluation method.Firstly,this method extracts the chroma and gradient features in the spatial domain,which are used to characterize the color information and spatial structure information of images.The texture detail information of the response of the log-Gabor filter bank and spatial frequency features are extracted in the frequency domain,which are used to be joint features.Then,random forest is implemented for learning the mapping relationship between the feature vector and the subjective opinion score to predict the objective quality score.Experiments conducted on three standard databases,i.e.TID2013,TID2008,and CSIQ show that the comprehensive evaluation performance by our method is better than the state-of-the-art full reference assessment algorithms,especially on TID2013 database,the Pearson linear correlation coefficient value can reach 0.9397.

Key words: Frequency domain, Image quality assessment, Random forest, Spatial domain

中图分类号: 

  • TP391
[1]WANG Z,BOVIK A C,WANG Z,et al.Modern Image Quality Assessment[M].Morgan & Claypool,2006.
[2]WANG Z,BOVIK A C,SHEIKHH R,et al.Image quality assessment:from error visiblity to structural similarity[J].IEEE Transactions on Image Processing,2004,13(4):600-612.
[3]ZHANG L,ZHANG L,MOU X Q,et al.FSIM:a feature similarity index for image quality assessment[J].IEEE Transactions on Image Processing,2011,20(8):2378-2386.
[4]GU K,LI L,LU H,et al.A fast reliable image quality predictor by fusing micro and macro-structures[J].IEEE Transactions on Industrial Electronics,2017,64(5):3903-3912.
[5]XUE W F,ZHANG L,MOU X Q,et al.Gradient magnitudesimilarity deviation:a highly efficient perceptual image quality index[J].IEEE Transactions on Image Processing,2014,23(2):684-695.
[6]YANG G,LI D,LU F,et al.RVSIM:a feature similarity method for full-reference image quality assessment[J].EURASIP Journal on Image & Video Processing,2018,2018(1):6.
[7]DONG W,BIE H,LU L,et al.Image quality assessment by considering multiscale and multidirectional visibility differences in shearlet domain[J].IEEE Access,2019,7:78715-78728.
[8]ZHANG L,SHEN Y,LI H Y.VSI:A visual saliency-induced index for perceptual image quality assessment[J].IEEE Transactions on Image Processing,2014,23(10):4270-4281.
[9]SMOLA A J,GUNTUKU S C.A tutorial on support vector regression[J].Statistics and Computing,2004,14:199-222.
[10]BREIMAN L.Random forests[J].Machine Learing,2001,45(1):5-32.
[11]HUANG G B,ZHU Q Y,SIEW C K.Extreme learning ma-chine:theory and applications[J].Neurocomputing,2006,70(1):489-501.
[12]HANSEN L K,SALAMON P.Neural network ensembles[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1990,12(10):993-1001.
[13]NARWARIA M,LIN W.SVD-based quality metric for imageand video using machine learning[J].IEEE Transactions on Systems,Man and Cybernetics,Part B (Cybernetics),2012,42(2):347-364.
[14]LIU T J,LIN W,KUO C C J.Image quality assessment usingmulti-method fusion[J].IEEE Transactions on Image Proces-sing,2013,22(5):1793-1807.
[15]PEI S C,CHEN L H.Image quality assessment using human visual DOG model fused with random forest[J].IEEE Transactions on Image Processing,2015,24(11):3282-3292.
[16]GAO F,WANG Y,LI P,et al.DeepSim:Deep similarity forimage quality assessment[J].Neurocomputing,2017,257(27):104-114.
[17]LIU H,YANG H,PAN Z K,et al.A learning based image quality assessment model assisted with visual saliency and gradient features[C]//2019 IEEE 4th International Conference on Signal and Image Processing.
[18]GROSS M H,KOCH R.Visualization of multidimensional shape and texture features in laser range data using complex-valued Gabor wavelets[J].IEEE Transactions on Visualization and Computer Graphics,1995,1(1):44-59.
[19]FIELD D J.Relations between the statistics of natural images and the response properties of cortical cells[J].Journal of the Optical Society of America.A,Optics and Image Science,1987,4(12):2379-2394.
[20]PONOMARENKO N,JIN L,LEREMEIEV O,et al.Image database TID2013:Peculiarities,results and perspectives[J].Signal Processing:Image Communication,2015,1(30):55-77.
[21]PONOMARENKO N,LUKIN V,ZELENSKY A,et al.TID2008:a database for evaluation of full-reference visual quality assessment metrics[J].Advances of Modern Radio electro-nics,2009,1(10):30-45.
[22]LARSON E C,CHANDLER D M.Most apparent distortion:full reference image quality assessment and the role of strategy[J].Journal of Electronic Imaging,2010,19(1):1-21.
[23]WANG Z,LI Q.Information content weighting for perceptualimage quality assessment[J].IEEE Transaction on Image Processing,2011,20(5):1185-1198.
[24]BAE S H,KIM M.A novel image quality assessment with glo-bally and locally consilient visual quality perception[J].IEEE Transactions on Image Processing,2016,25(5):2392-2406.
[25]GAO L X,LIU G J,ZHANG X D.Fast lifting IQA algorithm of the structure similarity index[J].Journal of Computer-Aided Design and Computer Graphics,2017,29(7):1314-1323.
[1] 高振卓, 王志海, 刘海洋.
嵌入典型时间序列特征的随机Shapelet森林算法
Random Shapelet Forest Algorithm Embedded with Canonical Time Series Features
计算机科学, 2022, 49(7): 40-49. https://doi.org/10.11896/jsjkx.210700226
[2] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[3] 阙华坤, 冯小峰, 刘盼龙, 郭文翀, 李健, 曾伟良, 范竞敏.
Grassberger熵随机森林在窃电行为检测的应用
Application of Grassberger Entropy Random Forest to Power-stealing Behavior Detection
计算机科学, 2022, 49(6A): 790-794. https://doi.org/10.11896/jsjkx.210800032
[4] 王文强, 贾星星, 李朋.
自适应的集成定序算法
Adaptive Ensemble Ordering Algorithm
计算机科学, 2022, 49(6A): 242-246. https://doi.org/10.11896/jsjkx.210200108
[5] 尹文兵, 高戈, 曾邦, 王霄, 陈怡.
基于时频域生成对抗网络的语音增强算法
Speech Enhancement Based on Time-Frequency Domain GAN
计算机科学, 2022, 49(6): 187-192. https://doi.org/10.11896/jsjkx.210500114
[6] 章晓庆, 方建生, 肖尊杰, 陈浜, RisaHIGASHITA, 陈婉, 袁进, 刘江.
基于眼前节相干光断层扫描成像的核性白内障分类算法
Classification Algorithm of Nuclear Cataract Based on Anterior Segment Coherence Tomography Image
计算机科学, 2022, 49(3): 204-210. https://doi.org/10.11896/jsjkx.201100085
[7] 刘振宇, 宋晓莹.
一种可用于分类型属性数据的多变量回归森林
Multivariate Regression Forest for Categorical Attribute Data
计算机科学, 2022, 49(1): 108-114. https://doi.org/10.11896/jsjkx.201200189
[8] 邢豪, 李明.
基于3D CNNS的深度伪造视频篡改检测
Deepfake Video Detection Based on 3D Convolutional Neural Networks
计算机科学, 2021, 48(7): 86-92. https://doi.org/10.11896/jsjkx.210200127
[9] 郑建华, 李小敏, 刘双印, 李迪.
融合级联上采样与下采样的改进随机森林不平衡数据分类算法
Improved Random Forest Imbalance Data Classification Algorithm Combining Cascaded Up-sampling and Down-sampling
计算机科学, 2021, 48(7): 145-154. https://doi.org/10.11896/jsjkx.200800120
[10] 曹扬晨, 朱国胜, 祁小云, 邹洁.
基于随机森林的入侵检测分类研究
Research on Intrusion Detection Classification Based on Random Forest
计算机科学, 2021, 48(6A): 459-463. https://doi.org/10.11896/jsjkx.200600161
[11] 李娜娜, 王勇, 周林, 邹春明, 田英杰, 郭乃网.
基于特征重要度二次筛选的DDoS攻击随机森林检测方法
DDoS Attack Random Forest Detection Method Based on Secondary Screening of Feature Importance
计算机科学, 2021, 48(6A): 464-467. https://doi.org/10.11896/jsjkx.200900101
[12] 徐佳庆, 胡小月, 唐付桥, 王强, 何杰.
基于随机森林的高性能互连网络阻塞故障检测
Detecting Blocking Failure in High Performance Interconnection Networks Based on Random Forest
计算机科学, 2021, 48(6): 246-252. https://doi.org/10.11896/jsjkx.201200142
[13] 周益旻, 刘方正, 王勇.
基于混合方法的IPSec VPN加密流量识别
IPSec VPN Encrypted Traffic Identification Based on Hybrid Method
计算机科学, 2021, 48(4): 295-302. https://doi.org/10.11896/jsjkx.200700189
[14] 张天瑞, 魏铭琦, 高秀秀.
基于IPSO-WRF的选择性激光烧结件气泡溶解时间预测模型
Prediction Model of Bubble Dissolution Time in Selective Laser Sintering Based on IPSO-WRF
计算机科学, 2021, 48(11A): 638-643. https://doi.org/10.11896/jsjkx.210300080
[15] 刘振鹏, 苏楠, 秦益文, 卢家欢, 李小菲.
FS-CRF:基于特征切分与级联随机森林的异常点检测模型
FS-CRF:Outlier Detection Model Based on Feature Segmentation and Cascaded Random Forest
计算机科学, 2020, 47(8): 185-188. https://doi.org/10.11896/jsjkx.190600162
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!