Computer Science ›› 2022, Vol. 49 ›› Issue (5): 98-104.doi: 10.11896/jsjkx.210100224

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Underwater Image Quality Assessment Based on HVS

LU Ting, HOU Guo-jia, PAN Zhen-kuan, WANG Guo-dong   

  1. College of Computer Science and Technology,Qingdao University,Qingdao,Shandong 266071,China
  • Received:2021-01-28 Revised:2021-04-20 Online:2022-05-15 Published:2022-05-06
  • About author:LU Ting,born in 1996,postgraduate,is a student member of China Computer Federation.Her main research interests include image processing and image quality evaluation.
    HOU Guo-jia,born in 1986,Ph.D,associate professor,postgraduate supervisor,is a member of China Computer Federation.His main research interests include image/video processing and image quality assessment,and pattern recognition.
  • Supported by:
    National Natural Science Foundation of China(61901240),Natural Science Foundation of Shandong,China(ZR2019BF042,ZR2019MF050),China Scholarship Council(201908370002) and China Postdoctoral Science Foundation(2017M612204).

Abstract: Due to the absorption and scattering effects under water,underwater image often suffers from blurring,low contrast,color casting and so on.The degraded images will decline the accuracy and effectiveness in underwater archaeology,marine ecological research,underwater target detection and tracking.On the other hand,underwater image quality assessment plays a key goal in the development and exploration of the ocean.An effective underwater image quality evaluation system can provide a gui-dance for optimizing underwater enhancement and restoration algorithms and promote the progress of underwater vision.Therefore,it is desire to design an effective and robust algorithm for underwater image quality evaluation.Since the atmospheric image quality evaluation methods don’t consider the characteristics of the water absorption of light,they aren’t suitable for evaluating underwater image quality.Additionally,there are few effective metrics for underwater images quality evaluation up to now.To address this problem,we propose a new no-reference underwater image quality measure containing color index,contrast,and sharpness indexes,dubbed CCS,which has stronger correlation with human subjective perception.These attributes not only are sensitive to the physical characteristics of the water,but also the human visual system (HVS) is sensitive to the changes of the visual properties such as color,contrast,and edge structures.To verify the performance of the proposed CCS,we conduct considerable experiments on a small underwater image dataset comparing with the other four non-reference metrics including CPBD,BRISQUE,UIQM and UCIQE.It can be seen that our CCS metric is higher about 13% than UIQM in terms of RMSE,moreover,is higher above 10% than UIQM and UCIQE in terms of PLCC,SROCC,and KROCC.Experimental results demonstrate that the proposed CCS metric has a higher correlation with subjective evaluations,which can effectively and accurately evaluate the underwater image quality.

Key words: Colorful measure, Contrast measure, Human visual system, Image quality assessment, No-reference, Sharpness measure

CLC Number: 

  • TP391.4
[1]LIU R S,FAN X,ZHU M,et al.Real-World Underwater Enhancement:Challenges,Benchmarks,and Solutions Under Natural Light[J].IEEE Transactions on Circuits and Systems for Video Technology,2020,30(12):4861-4875.
[2]HOU G J,ZHAO X,PAN Z K,et al.Benchmarking Underwater Image Enhancement and Restoration,and Beyond[J].IEEE Access,2020,8:122078-122091.
[3]CHEN L L,ZHU F,SHENG B,et al.Quality Evaluation of Co-lor Image Based on Discrete Quaternion Fourier Transform[J].Computer Science,2018,45(8):70-74.
[4]WANG S,YU W,TIAN C.Blind quality metric of super-resolution reconstructed images based on multi-order structure representation[J].Journal of Chongqing University of Posts and Telecommunications (Natural Science Edition),2021,33(2):280-288.
[5]WANG Z,BOVIK A C,SHEIKH H R,et al.Image quality assessment:from error visibility to structural similarity[J].IEEE Transaction on Image Processing,2004,13(4):600-612.
[6]PANETTA K,GAO C,AGAIAN S.No reference color image contrast and quality measures[J].IEEE Transaction on Consumer Electronics,2013,59(3):643-651.
[7]YANG Y S,SANG Q B.No-reference Color Noise Images Qua-lity Assessment Without Learning[J].Computer Science,2020,47(10):161-168.
[8]CHEN X,LI L D,LI Q Y,et al.No-reference Quality Assessment of Depth Images Based on Natural Scenes Statistics[J].Computer Science,2019,46(6):256-262.
[9]MITTAL A,MOORTHY A K,BOVIK A C.No-ReferenceImage Quality Assessment in the Spatial Domain[J].IEEE Tran-sactions on Image Progressing,2012,21(12):4695-4708.
[10]MA K,LIU W,ZHANG K,et al.End-to-End Blind Image Qua-lity Assessment Using Deep Neural Networks[J].IEEE Tran-sactions on Image Progressing,2018,27(3):1202-1213.
[11]FANG Y,MA K,WANG Z,et al.No-reference Quality Assessment of Contrast-Distorted Images Based on Natural Scene Statistics[J].IEEE Signal Processing Letters,2014,22(7):838-842.
[12]FU Y Y.Color image quality measures and retrieval[M]//New Jersey Institute of Technology.Newark,NJ,United States,2006.
[13]CHOI L K,YOU J,BOVIK A C.Referenceless Prediction ofPerceptual Fog Density and Perceptual Image Defogging[J].IEEE Transactions on Image Processing,2015,24(11):3888-3901.
[14]TANG S Q,LI C L,TIAN Q.Underwater image quality assessment based on human visual[C]//2020 13th International Congress on Image and Signal Processing,BioMedical Engineering and Informatics(CISP-BMEI).2020:378-382.
[15]YANG M,SOWMYA A.An Underwater Colour Image QualityEvaluation Metric[J].IEEE Transactions on Image Processing,2015,24(12):6062-6071.
[16]PANETTA K,GAO C,AGAIAN S.Human-Visual-System-Inspired Underwater Image Quality Measures[J].IEEE Journal of Oceanic Engineering,2016,41(3):541-551.
[17]SONG W,LIU S,HUANG D M,et al.Non-reference underwater video quality assessment method for small size samples[J].Journal of Image and Graphics,2020,25(9):1787-1799.
[18]GALDRAN A,PARDO D,PICÓN A,et al.Automatic Red-Channel underwater image restoration[J].Journal of Visual Communication & Image Representation,2015,26:132-145.
[19]GATTS C,RIZZI A,MARINI D.ACE:An Automatic ColorEqualization Algorithm[C]//Conference on Colour in Graphics.2002.
[20]GROEN I I A,GHEBREAB S,PRINS H,et al.From image sta-tistics to scene gist:Evoked neural activity reveals transition from low-level natural image structure to scene category[J].J. Neurosci,2013,33(48):18814-18824.
[21]PANETTA K,SAMANI A,AGAIAN S S.Choosing the Optimal Spatial Domain Measure of Enhancement for Mammogram Images[J].International Journal of Biomed Imaging,2014,937849:1-8.
[22]CODEVILLA F M,BOTELHO S S D C,JR P D,et al.Underwater Single Image Restoration Using Dark Channel Prior[C]//2014 Symposium on Automation and Computation for Naval,Offshore and Subsea (NAVCOMP).IEEE,2016:18-21.
[23]IQBAL K,ABDUL S R,OSMAN M,et al.Underwater Image Enhancement Using an Integrated Colour Model[J].International of Computer Ence,2007,32(2):239-244.
[24]LIU L,LIU B,HUANG H,et al.No-reference image quality assessment based on spatial and spectral entropies[J].Signal Processing Image Communication,2014,29(8):856-863.
[25]PENG Y T,COSMAN P C.Underwater Image RestorationBased on Image Blurriness and Light Absorption[J].IEEE Transactions on Image Processing,2017,26(4):1579-1594.
[26]LIU X,ZHANG H,CHEUNG Y M,et al.Efficient Single Image Dehazing and Denosing:An Efficient Multi-scale Correlated Wavelet Approach[J].Computer Vision and Image Understanding,2017,162(8):23-33.
[27]MERTENS L E,REPLOGLE F S.Use of point spread and beam spread functions for analysis of imaging systems in water[J].Journal of the Optical Society of America,1977,67(8):1105-1117.
[28]ANCUTI C,ANCUTI C O,HABER T,et al.Enhancing underwater imagesand videos by fusion[C]//IEEE Conferencec on Computer Vision & Pattern Recognition.IEEE,2012:81-88.
[29]LI C Y,GUO J C,CONG R M,et al.Underwater Image Enhancement by Dehazing With Minimum Information Loss and Histogram Distribution Prior[J].IEEE Transactions on Image Processing,2016,25(12):5664-5677.
[30]PAN P W,YUAN F,CHENG E.Underwater image de-scatte-ring and enhancing using dehazenet and HWD[J].Journal of Marine Science and Technology,2018,26(4):531-540.
[31]FU X Y,CAO X Y.Underwater image enhancement with glo-bal-local networks and compressed-histogram equalization[J].Signal Processing:Image Communication,2020,86:115892.
[32]LI X J,HOU G J,TAN L,et al.A Hybrid Framework for Underwater Image Enhancement[J].IEEE Access,2020,8:197448-197462.
[33]SUN W,ZHOU F,LIAO Q.MDID:A multiply distorted image database for image quality assessment[J].Pattern Recognition,2017,61:153-168.
[34]NARVKAR N D,KARAM L J.A No-Reference Image BlurMetric Based on the Cumulative Probability of Blur Detection (CPBD)[J].IEEE Transactions on Image Processing,2011,20(9):1678-1683.
[1] YANG Xiao-qin, LIU Guo-jun, GUO Jian-hui, MA Wen-tao. Full Reference Color Image Quality Assessment Method Based on Spatial and Frequency Domain Joint Features with Random Forest [J]. Computer Science, 2021, 48(8): 99-105.
[2] ZHU Ling-ying, SANG Qing-bing, GU Ting-ting. No-reference Stereo Image Quality Assessment Based on Disparity Information [J]. Computer Science, 2020, 47(9): 150-156.
[3] LI Kai-wen, XU Lin, CHEN Qiang. Relative Image Quality Assessment Based on CPNet [J]. Computer Science, 2020, 47(11): 159-167.
[4] ZHAO Liang, PENG Hong-jing, DU Zhen-long. Content-aware Image Retargeting Algorithm Based on Explicit SURF Feature Preservation [J]. Computer Science, 2020, 47(11): 192-198.
[5] YANG Yun-shuo, SANG Qing-bing. No-reference Color Noise Images Quality Assessment Without Learning [J]. Computer Science, 2020, 47(10): 161-168.
[6] CHEN Xi, LI Lei-da, LI Qiao-yue, HAN Xi-xi, ZHU Han-cheng. No-reference Quality Assessment of Depth Images Based on Natural Scenes Statistics [J]. Computer Science, 2019, 46(6): 256-262.
[7] QU Xing-xing, ZHANG Fan, LIU Bin and ZHANG Ruo-ya. Survey on Image Inverse Halftoning and its Quality Evaluation [J]. Computer Science, 2016, 43(Z6): 109-115.
[8] XIONG Run-sheng, LI Chao-feng and ZHANG Wei. No-reference Stereoscopic Image Quality Assessment Based on Wavelet Transform [J]. Computer Science, 2015, 42(9): 282-284.
[9] HUA Dong and YU Hong-sheng. Digital Fusion Image Quality Objective Assessment Method Based on Visual Information Fidelity [J]. Computer Science, 2014, 41(Z6): 224-226.
[10] SANG Qing-bing,LIANG Di-lin,WU Xiao-jun and LI Chao-feng. Gradient Structural Similarity Image Assessment Index Based on Dilation [J]. Computer Science, 2014, 41(6): 287-290.
[11] CHU Jiang and CHEN Qiang. Research on Natural Scene Statistics in Color Space [J]. Computer Science, 2014, 41(11): 309-312.
[12] SONG Xing-guang, ZHANG Chun-tian, SU Yu-ting. Design of Adaptive Watermarking Algorithms for Video Signals Using Subjective Tests [J]. Computer Science, 2009, 36(8): 291-295.
[13] YANG Hong-jun,YANG Sheng,XIA Tai-wu. DCT Based Public Watermarking Algorithm with Visual Model [J]. Computer Science, 2009, 36(7): 281-283.
[14] . [J]. Computer Science, 2009, 36(6): 265-267.
[15] . [J]. Computer Science, 2009, 36(3): 226-231.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!