Computer Science

Computer Science ›› 2020, Vol. 47 ›› Issue (11): 159-167.doi: 10.11896/jsjkx.190900052

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Relative Image Quality Assessment Based on CPNet

LI Kai-wen, XU Lin, CHEN Qiang   

  1. School of Computer Science and Engineering,Nanjing University of Science and Technology,Nanjing 210094,China
  • Received:2019-09-06 Revised:2019-11-21 Online:2020-11-15 Published:2020-11-05
  • About author:LI Kai-wen,born in 1994,postgraduate.His main research interests includeima-ge quality evaluation and so on.
    CHEN Qiang,born in 1979,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include image processing and analysis,pattern recognition and machine learning.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (61671242).

PDF (PC)

711

Abstract: For two images with different quality,the human visual system (HVS) can easily distinguish their quality difference.Thus,it is more accurate to judge the relative quality of two images by simulating HVS than to give the absolute quality score of images.A CPNet (Compare-net) model for evaluating the relative quality between images is proposed in this paper.It is a score-independent algorithm that uses the form of image combination to solve the limitation of data volume.Compared with the absolute quality score label,the proposed relative quality label and relative quality order label have a broader application scenario than the absolute quality score label and are more convenient and accurate to obtain.Firstly,by analyzing the influence of convolutional neural network structure related parameters on network performance,a reasonable network infrastructure is constructed.Secondly,the quality difference characteristics of two images are obtained by the methods of two-channel input network and the feature differentiation,and the classification learning is completed by combining the relative quality labels of the image pairs.Finally,experiments on public database show that the accuracy of the proposed algorithm is better than that of other algorithms.CPNet achieved the best accuracy of 0.971 and 0.947 in the same reference image experiment,and also achieved a very competitive accuracy in different reference image experiments,0.926 and 0.860 respectively.In addition,a three-channel network is designed and experiments are carried out to explore the possibility of extending the proposed algorithm to multiple channels.

Key words: Convolutional network, CPNet, Image quality assessment, Quality difference, Relative quality order

CLC Number: 

  • TP391.4
[1] ALAKUIJALA J,OBRYK R,STOLIARCHUK O,et al.Guetzli:Perceptually guided JPEG encoder[EB/OL].arXiv:arxiv/abs/1703.04421.
[2] CHANNAPPAYYA S S,BOVIK A C,CARAMANIS C,et al.Design of linear equalizers optimized for the structural similarity index [J].IEEE Transactions on Image Processing,2008,17(6):857-872.
[3] GU K,TAO D C,QIAO J F,et al.Learning a no-reference quality assessment model of enhanced images with big data [J].IEEE Transactions on Neural Networks and Learning Systems,2018,29(4):1301-1313.
[4] ZHOU W,BOVIK A C.Mean squared error:Love it or leave it?A new look at Signal Fidelity Measures [J].IEEE Signal Processing Magazine,2009,26(1):98-117.
[5] ZHANG L,ZHANG L,MOU X Q,et al.FSIM:A feature similarity index for image quality assessment [J].IEEE Transactions on Image Processing,2011,20(8):2378.
[6] VENKATESH B R,PERKIS A.An HVS-based no-referenceperceptual quality assessment of JPEG coded images using neural networks [C]//Proceedings of the IEEE International Conference on Image Processing.Genova:IEEE Press,2005,1:I-433.
[7] BRANDÃO T,QUELUZ M P.No-reference image quality as-sessment based on DCT domain statistics [J].Signal Processing,2008,88(4):822-833.
[8] PAN F,LIN X,RAHARDJA S,et al.Measuring blocking artifacts using edge direction information [C]//Proceedings of the IEEE International Conference on Multimedia and Expo.Taipei:IEEE Press,2004:1491-1494.
[9] VLACHOS T.Detection of blocking artifacts in compressed video [J].Electronics Letters,2000,36(13):1106-1108.
[10] CHEN M J,BOVIK A C.No-reference image blur assessment using multiscale gradient [C]//2009 International Workshop on Quality of Multimedia Experience.IEEE,2011.
[11] CIANCIO A,COSTA A L,SILVA E A,et al.No-reference blur assessment of digital pictures based on multifeature classifiers [J].IEEE Transactions on Image Processing,2010,20(1):64-75.
[12] LI C F,BOVIK A C,WU X J.Blind image quality assessmentusing a general regression neural network [J].IEEE Transactions on Neural Networks,2011,22(5):793-799.
[13] YE P,DOERMANN D.No-reference image quality assessment using visual codebooks [J].IEEE Transactions on Image Processing,2012,21(7):3129-3138.
[14] ZHANG Y,WANG C,MOU X Q.SPCA:A no-reference image quality assessment based on the statistic property of the PCA on nature images [J].Digital Photography IX,2013,8660(1):311-316.
[15] ZHOU L Y,ZHANG Z B.No-reference image quality assessment based on noise,blurring and blocking effect [J].Optik-International Journal for Light and Electron Optics,2014,125(19):5677-5680.
[16] LIU L X,LIU B,HUANG H,et al.Noreference image quality assessment based on spatial and spectral entropies [J].Signal Processing:Image Communication,2014,29(8):856-863.
[17] SAAD M A,BOVIK A C,CORMACK L.A DCT statistics-based blind image quality index [J].IEEE Signal Processing Letter,2010,17(6):583-586.
[18] SAAD M A,BOVIK A C,CHARRIER C.DCT statistics model-based blind image quality assessment [C]//IEEE International Conference on Image Processing.Brussels:IEEE Press,2011:3093-3096.
[19] SAAD M A,BOVIK A C,CHARRIER C.Blind image quality assessment:a natural scene statistics approach in the DCT domain [J].IEEE Transactions on Image Processing,2012,21(8):3339-3352.
[20] MOORTH A K,BOVIK A C.A two-step framework for constructing blind image quality Indice [J].IEEE Signal Processing Letter,2012,17(5):513-516.
[21] MOORTH A K,BOVIK A C.Blind image quality assessment:From natural scene statistics to perceptual quality [J].IEEE Transactions on Image Processing,2011,20(12):3350-3364.
[22] TANG H X,JOSHI N,KAPOOR A.Learning a blind measure of perceptual image quality [C]//Proceedings of the IEEE International Conference on Image Processing.Brussels:IEEE Press,2011:305-312.
[23] MITTAL A,MOORTHY A K,BOVIK A C.No-reference image quality assessment in the spatial domain [J].IEEE Transactions on Image Processing,2012,21(12):4695-4708.
[24] MITTAL A,SOUNDARARAJAN R,BOVIK A C.Making a‘completely blind' image quality analyzer [J].IEEE Signal Processing Letters,2013,20(3):209-212.
[25] MITTAL A,SOUNDARARAJAN R,MURALIDHAR G S,et al.Blind image quality assessment without training on human opinion scores [C]//Proceedings of the SPIE Human Vision and Electronic Imaging XVIII.Florida:IEEE Press,2013.
[26] KANG L,YE P,LI Y,et al.Convolutional neural networks for no-reference image quality assessment [C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Columbus,USA,2014:1733-1740.
[27] KIM J,LEE S.Fully Deep Blind image quality predictor [J].IEEE Journal of Selected Topics in Signal Processing,2017,11(1):206-220.
[28] LI J,ZOU L,YAN J,et al.No-reference image quality assessment using Prewitt magnitude based on convolutional neural networks [J].Signal Image and Video Processing,2016,10(4):609-616.
[29] LI Y M,PO L M,FENG L T,et al.No-reference image quality assessment with deep convolutional neural networks [C]//Proceedings of the IEEE International Conference on Digital Signal Processing.London:IEEE Press,2017:685-689.
[30] BOSSE S,MANIRY D,MÜLLER K R,et al.Deep Neural Networks for No-Reference and Full-Reference Image Quality Assessment [J].IEEE Transactions on Image Processing,2016,PP(99):1-1.
[31] GU J,MENG G F,XIANG S M,et al.Blind image quality assessment via learnable attention-based pooling [J].Pattern Recognition,2019,91:332-334.
[32] GAO F,TAO D C,GAO X B,et al.Learning to rank for blind image quality assessment [J].IEEE Transactions on Neural Networks and Learning Systems,2015,26(10):2275-2290.
[33] LIU X L,WEIJER J V D,BAGDANOV A D.RankIQA:Learning from Rankings for No-Reference Image Quality Assessment [C]//Proceedings of the 2017 IEEE International Conference on Computer Vision (ICCV).Venice:IEEE Press,2017:1040-1049.
[1] TAN Ying-ying, WANG Jun-li, ZHANG Chao-bo. Review of Text Classification Methods Based on Graph Convolutional Network [J]. Computer Science, 2022, 49(8): 205-216.
[2] LI Zong-min, ZHANG Yu-peng, LIU Yu-jie, LI Hua. Deformable Graph Convolutional Networks Based Point Cloud Representation Learning [J]. Computer Science, 2022, 49(8): 273-278.
[3] WANG Ming, PENG Jian, HUANG Fei-hu. Multi-time Scale Spatial-Temporal Graph Neural Network for Traffic Flow Prediction [J]. Computer Science, 2022, 49(8): 40-48.
[4] SUN Fu-quan, CUI Zhi-qing, ZOU Peng, ZHANG Kun. Brain Tumor Segmentation Algorithm Based on Multi-scale Features [J]. Computer Science, 2022, 49(6A): 12-16.
[5] ZHAO Xiao-hu, YE Sheng, LI Xiao. Multi-algorithm Fusion Behavior Classification Method for Body Bone Information Reconstruction [J]. Computer Science, 2022, 49(6): 269-275.
[6] LU Ting, HOU Guo-jia, PAN Zhen-kuan, WANG Guo-dong. Underwater Image Quality Assessment Based on HVS [J]. Computer Science, 2022, 49(5): 98-104.
[7] ZHOU Hai-yu, ZHANG Dao-qiang. Multi-site Hyper-graph Convolutional Neural Networks and Application [J]. Computer Science, 2022, 49(3): 129-133.
[8] PAN Zhi-hao, ZENG Bi, LIAO Wen-xiong, WEI Peng-fei, WEN Song. Interactive Attention Graph Convolutional Networks for Aspect-based Sentiment Classification [J]. Computer Science, 2022, 49(3): 294-300.
[9] ZHANG Wei-qi, TANG Yi-feng, LI Lin-yan, HU Fu-yuan. Image Stream From Paragraph Method Based on Scene Graph [J]. Computer Science, 2022, 49(1): 233-240.
[10] YANG Xiao-qin, LIU Guo-jun, GUO Jian-hui, MA Wen-tao. Full Reference Color Image Quality Assessment Method Based on Spatial and Frequency Domain Joint Features with Random Forest [J]. Computer Science, 2021, 48(8): 99-105.
[11] SONG Long-ze, WAN Huai-yu, GUO Sheng-nan, LIN You-fang. Multi-task Spatial-Temporal Graph Convolutional Network for Taxi Idle Time Prediction [J]. Computer Science, 2021, 48(7): 112-117.
[12] QING Lai-yun, ZHANG Jian-gong, MIAO Jun. Temporal Modeling for Online Anomaly Detection [J]. Computer Science, 2021, 48(7): 206-212.
[13] LYU Ming-qi, HONG Zhao-xiong, CHEN Tie-ming. Traffic Flow Forecasting Method Combining Spatio-Temporal Correlations and Social Events [J]. Computer Science, 2021, 48(2): 264-270.
[14] ZHANG Hui. Multiple Fault Localization Method Based on Deep Convolutional Network [J]. Computer Science, 2021, 48(11A): 88-92.
[15] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.