Computer Science ›› 2021, Vol. 48 ›› Issue (8): 99-105.doi: 10.11896/jsjkx.200700106

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Full Reference Color Image Quality Assessment Method Based on Spatial and Frequency Domain Joint Features with Random Forest

YANG Xiao-qin, LIU Guo-jun, GUO Jian-hui, MA Wen-tao   

  1. School of Mathematics and Statistics,Ningxia University,Yinchuan 750021,China
  • Received:2020-07-16 Revised:2020-09-03 Published:2021-08-10
  • About author:YANG Xiao-qin,born in 1996,postgra-duate.Her main research interests include image quality assessment and machine learning.(yxq258351@163.com)LIU Guo-jun,born in 1978,Ph.D,professor,Ph.D supervisor,master tutor.His main research interests include wavelet and partial differential equations for image processing,image quality assessment,and machine learning.
  • Supported by:
    Natural Science Foundation of Ningxia(2018AAC03014),National Natural Science Foundation of China(61461043,51769026),Key Research and Development Projects of Ningxia(2019BEG03056) and Graduate Innovation Project of Ningxia University(GIP2019011).

Abstract: This paper is to design an objective evaluation algorithm that automatically evaluates image quality and is consistent with the human visual system.In view of the fact that most traditional full reference image quality assessment methods only analyze images in the spatial domain,and have shortcomings in pooling strategies,this paper proposes a random forest based spatial-frequency domain joint feature full reference color image quality evaluation method.Firstly,this method extracts the chroma and gradient features in the spatial domain,which are used to characterize the color information and spatial structure information of images.The texture detail information of the response of the log-Gabor filter bank and spatial frequency features are extracted in the frequency domain,which are used to be joint features.Then,random forest is implemented for learning the mapping relationship between the feature vector and the subjective opinion score to predict the objective quality score.Experiments conducted on three standard databases,i.e.TID2013,TID2008,and CSIQ show that the comprehensive evaluation performance by our method is better than the state-of-the-art full reference assessment algorithms,especially on TID2013 database,the Pearson linear correlation coefficient value can reach 0.9397.

Key words: Frequency domain, Image quality assessment, Random forest, Spatial domain

CLC Number: 

  • TP391
[1]WANG Z,BOVIK A C,WANG Z,et al.Modern Image Quality Assessment[M].Morgan & Claypool,2006.
[2]WANG Z,BOVIK A C,SHEIKHH R,et al.Image quality assessment:from error visiblity to structural similarity[J].IEEE Transactions on Image Processing,2004,13(4):600-612.
[3]ZHANG L,ZHANG L,MOU X Q,et al.FSIM:a feature similarity index for image quality assessment[J].IEEE Transactions on Image Processing,2011,20(8):2378-2386.
[4]GU K,LI L,LU H,et al.A fast reliable image quality predictor by fusing micro and macro-structures[J].IEEE Transactions on Industrial Electronics,2017,64(5):3903-3912.
[5]XUE W F,ZHANG L,MOU X Q,et al.Gradient magnitudesimilarity deviation:a highly efficient perceptual image quality index[J].IEEE Transactions on Image Processing,2014,23(2):684-695.
[6]YANG G,LI D,LU F,et al.RVSIM:a feature similarity method for full-reference image quality assessment[J].EURASIP Journal on Image & Video Processing,2018,2018(1):6.
[7]DONG W,BIE H,LU L,et al.Image quality assessment by considering multiscale and multidirectional visibility differences in shearlet domain[J].IEEE Access,2019,7:78715-78728.
[8]ZHANG L,SHEN Y,LI H Y.VSI:A visual saliency-induced index for perceptual image quality assessment[J].IEEE Transactions on Image Processing,2014,23(10):4270-4281.
[9]SMOLA A J,GUNTUKU S C.A tutorial on support vector regression[J].Statistics and Computing,2004,14:199-222.
[10]BREIMAN L.Random forests[J].Machine Learing,2001,45(1):5-32.
[11]HUANG G B,ZHU Q Y,SIEW C K.Extreme learning ma-chine:theory and applications[J].Neurocomputing,2006,70(1):489-501.
[12]HANSEN L K,SALAMON P.Neural network ensembles[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,1990,12(10):993-1001.
[13]NARWARIA M,LIN W.SVD-based quality metric for imageand video using machine learning[J].IEEE Transactions on Systems,Man and Cybernetics,Part B (Cybernetics),2012,42(2):347-364.
[14]LIU T J,LIN W,KUO C C J.Image quality assessment usingmulti-method fusion[J].IEEE Transactions on Image Proces-sing,2013,22(5):1793-1807.
[15]PEI S C,CHEN L H.Image quality assessment using human visual DOG model fused with random forest[J].IEEE Transactions on Image Processing,2015,24(11):3282-3292.
[16]GAO F,WANG Y,LI P,et al.DeepSim:Deep similarity forimage quality assessment[J].Neurocomputing,2017,257(27):104-114.
[17]LIU H,YANG H,PAN Z K,et al.A learning based image quality assessment model assisted with visual saliency and gradient features[C]//2019 IEEE 4th International Conference on Signal and Image Processing.
[18]GROSS M H,KOCH R.Visualization of multidimensional shape and texture features in laser range data using complex-valued Gabor wavelets[J].IEEE Transactions on Visualization and Computer Graphics,1995,1(1):44-59.
[19]FIELD D J.Relations between the statistics of natural images and the response properties of cortical cells[J].Journal of the Optical Society of America.A,Optics and Image Science,1987,4(12):2379-2394.
[20]PONOMARENKO N,JIN L,LEREMEIEV O,et al.Image database TID2013:Peculiarities,results and perspectives[J].Signal Processing:Image Communication,2015,1(30):55-77.
[21]PONOMARENKO N,LUKIN V,ZELENSKY A,et al.TID2008:a database for evaluation of full-reference visual quality assessment metrics[J].Advances of Modern Radio electro-nics,2009,1(10):30-45.
[22]LARSON E C,CHANDLER D M.Most apparent distortion:full reference image quality assessment and the role of strategy[J].Journal of Electronic Imaging,2010,19(1):1-21.
[23]WANG Z,LI Q.Information content weighting for perceptualimage quality assessment[J].IEEE Transaction on Image Processing,2011,20(5):1185-1198.
[24]BAE S H,KIM M.A novel image quality assessment with glo-bally and locally consilient visual quality perception[J].IEEE Transactions on Image Processing,2016,25(5):2392-2406.
[25]GAO L X,LIU G J,ZHANG X D.Fast lifting IQA algorithm of the structure similarity index[J].Journal of Computer-Aided Design and Computer Graphics,2017,29(7):1314-1323.
[1] GAO Zhen-zhuo, WANG Zhi-hai, LIU Hai-yang. Random Shapelet Forest Algorithm Embedded with Canonical Time Series Features [J]. Computer Science, 2022, 49(7): 40-49.
[2] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[3] QUE Hua-kun, FENG Xiao-feng, LIU Pan-long, GUO Wen-chong, LI Jian, ZENG Wei-liang, FAN Jing-min. Application of Grassberger Entropy Random Forest to Power-stealing Behavior Detection [J]. Computer Science, 2022, 49(6A): 790-794.
[4] WANG Wen-qiang, JIA Xing-xing, LI Peng. Adaptive Ensemble Ordering Algorithm [J]. Computer Science, 2022, 49(6A): 242-246.
[5] YIN Wen-bing, GAO Ge, ZENG Bang, WANG Xiao, CHEN Yi. Speech Enhancement Based on Time-Frequency Domain GAN [J]. Computer Science, 2022, 49(6): 187-192.
[6] LU Ting, HOU Guo-jia, PAN Zhen-kuan, WANG Guo-dong. Underwater Image Quality Assessment Based on HVS [J]. Computer Science, 2022, 49(5): 98-104.
[7] ZHANG Xiao-qing, FANG Jian-sheng, XIAO Zun-jie, CHEN Bang, Risa HIGASHITA, CHEN Wan, YUAN Jin, LIU Jiang. Classification Algorithm of Nuclear Cataract Based on Anterior Segment Coherence Tomography Image [J]. Computer Science, 2022, 49(3): 204-210.
[8] LIU Zhen-yu, SONG Xiao-ying. Multivariate Regression Forest for Categorical Attribute Data [J]. Computer Science, 2022, 49(1): 108-114.
[9] ZHENG Jian-hua, LI Xiao-min, LIU Shuang-yin, LI Di. Improved Random Forest Imbalance Data Classification Algorithm Combining Cascaded Up-sampling and Down-sampling [J]. Computer Science, 2021, 48(7): 145-154.
[10] CAO Yang-chen, ZHU Guo-sheng, QI Xiao-yun, ZOU Jie. Research on Intrusion Detection Classification Based on Random Forest [J]. Computer Science, 2021, 48(6A): 459-463.
[11] LI Na-na, WANG Yong, ZHOU Lin, ZOU Chun-ming, TIAN Ying-jie, GUO Nai-wang. DDoS Attack Random Forest Detection Method Based on Secondary Screening of Feature Importance [J]. Computer Science, 2021, 48(6A): 464-467.
[12] XU Jia-qing, HU Xiao-yue, TANG Fu-qiao, WANG Qiang, HE Jie. Detecting Blocking Failure in High Performance Interconnection Networks Based on Random Forest [J]. Computer Science, 2021, 48(6): 246-252.
[13] ZHOU Yi-min, LIU Fang-zheng , WANG Yong. IPSec VPN Encrypted Traffic Identification Based on Hybrid Method [J]. Computer Science, 2021, 48(4): 295-302.
[14] ZHANG Tian-rui, WEI Ming-qi, GAO Xiu-xiu. Prediction Model of Bubble Dissolution Time in Selective Laser Sintering Based on IPSO-WRF [J]. Computer Science, 2021, 48(11A): 638-643.
[15] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!