Computer Science ›› 2022, Vol. 49 ›› Issue (3): 197-203.doi: 10.11896/jsjkx.201200263

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion

ZUO Jie-ge, LIU Xiao-ming, CAI Bing   

  1. School of Information Science and Technology,Dalian Maritime University,Dalian,Liaoning 116026,China
  • Received:2020-12-30 Revised:2021-04-09 Online:2022-03-15 Published:2022-03-15
  • About author:ZUO Jie -ge,born in 1997,postgraduate.Her main research interests include videoimage processing and image quality assessment.
    LIU Xiao -ming,born in 1959,professor.His main research interests include traffic electronic information system,navigation and radar information system.
  • Supported by:
    National Natural Science Foundation of China(62001078) and Maritime Safety Administration Foundation of Fujian Province,China(2018Z0093).

Abstract: In video surveillance and intelligent traffic,bad weather such as foggy,rainy and snowy can seriously affect the visibility of video images.Therefore,it is very important to quickly identify the current weather conditions and make adaptive clearness processing of surveillance videos.Aiming at the problems of poor effect of traditional weather recognition methods and lack of weather image data sets,a multi-class weather image blocks data set is constructed,and a weather recognition algorithm based on image blocks and feature fusion is proposed.The algorithm uses traditional methods to extract four features,namely average gradient,contrast,saturation and dark channel,which are taken as the shallow features of weather images.The algorithm uses transfer learning to fine -tune the VGG16 pre-training model,and extracts the full-connection layer features of the fine-tuning model,which are taken as the deep features of the weather image.The shallow and deep features of weather images are fused and used as the final features to train the Softmax classifier.The classifier can realize the recognition of foggy,rainy,snowy and sunny wea-ther images. Experimental results show that the recognition accuracy of the proposed algorithm can reach 99.26%,and the algorithm can be used as a weather recognition module in the adaptive video image sharpening system.

Key words: Convolutional neural network, Feature extraction, Feature fusion, Image blocks, Transfer learning, Weather recognition

CLC Number: 

  • TP391.41
[1]RIVERO J,GERBICH T,TEILUF V,et al.Weather Classification Using an Automotive LIDAR Sensor Based on Detections on Asphalt and Atmosphere[J].Sensors (Basel,Switzerland),2020,20(15):1-20.
[2]ZHANG Z,MA H D,FU H Y,et al.Scene-free multi-classweather classification on single images[J].Neurocomputing,2016,207(26):365-373.
[3]GUERRA J C V,KHANAM Z,EHSAN S,et al.Weather Clas-sification:A new multi-class dataset,data augmentation approach and comprehensive evaluations of convolutional neural networks[C]//2018 NASA/ESA Conference on Adaptive Hardware and Systems (AHS).Edinburgh,UK,2018:305-310.
[4]WANG Y,LI Y X.Research on Multi-class Weather Classification Algorithm Based on Multi-model Fusion[C]//2020 IEEE 4th Information Technology,Networking,Electronic and Automation Control Conference(ITNEC).Chongqing,China,2020:2251-2255.
[5]FANG C,LV C,CAI F,et al.Weather Classification for Outdoor Power Monitoring based on Improved SqueezeNet[C]//2020 5th International Conference on Information Science,Computer Technology and Transportation (ISCTT).Shenyang,China,2020:11-15.
[6]YE R,YAN B,MI J.BIVS:Block Image and Voting Strategy for Weather Image Classification[C]//2020 IEEE 3rd International Conference on Computer and Communication Engineering Technology (CCET).Beijing,China,2020:105-110.
[7]RAO Y M,LU J W,LIN J,et al.Runtime Network Routing for Efficient Image Classification[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2019,41(10):2291-2304.
[8]GUO Z Q,HU Y W,LIU P,et al.Outdoor weather image classification based on feature fusion[J].Journal of Computer Applications,2020,40(4):1023-1029.
[9]CHU W T,ZHENG X Y,DING D S.Camera as Weather Sensor:Estimating Weather Information from Single Images[J].Journal of Visual Communication and Image Representation,2017,46:233-249.
[10]LIN D,LU C W,HUANG H,et al.RSCM:Region Selection and Concurrency Model for Multi-Class Weather Recognition[J].IEEE Transactions on Image Processing,2017,26(9):4154-4167.
[11]JIN L S,CHEN M,JIANG Y Y,et al.Multi-Traffic Scene Perception Based on Supervised Learning[J].IEEE Access,2018,6:4287-4296.
[12]HE K M,SUN J,TANG X O.Single Image Haze RemovalUsing Dark Channel Prior[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2011,33(12):2341-2353.
[13]ARBANE M,BENLAMRI R,BRIK Y,et al.Transfer Learning for Automatic Brain Tumor Classification Using MRI Images[C]//2020 2nd International Workshop on Human-Centric Smart Environments for Health and Well-being(IHSH).Boumerdes,Algeria,2021:210-214.
[14]RIBANI R,MARENGONI M.A Survey of Transfer Learning for Convolutional Neural Networks[C]//2019 32nd SIBGRAPI Conference on Graphics,Patterns and Images Tutorials(SIBGRAPIT).Rio de Janeiro,Brazil,2019:47-57.
[15]RUSSAKOVSKY O,DENG J,SU H,et al.Imagenet large scale visual recognition challenge[J].International Journal of Computer Vision,2015,115(3):211-252.
[16]KRIZHEVSKY A,SUTSKEVER I,HINTON G E.Imagenetclassification with deep convolutional neural networks[J].Advances In Neural Information Processing Systems,2012,25(2):1097-1105.
[17]KINGMA D P,BA J L.Adam:A Method for Stochastic Optimization[C]//International Conference on Learning Representations 2015(ICLR 2015).San Diego,CA,2015:1-15.
[18]LIU W B,ZOU Z Y,XING W W.Feature Fusion Methods in Pattern Classification[J].Journal of Beijing University of Posts and Telecommunications,2017,40(4):1-8.
[19]SZEGEDY C,LIU W,JIA Y Q,et al.Going deeper with convolutions[C]//2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston,MA,2015:1-9.
[20]HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learningfor Image Recognition[C]//2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Las Vegas,NV,2016:770-778.
[21]GOSWAMI S.Towards Effective Categorization of WeatherImages using Deep Convolutional Architecture[C]//2020 International Conference on Industry 4.0 Technology (I4Tech).Pune,India,2020:76-79.
[1] ZHOU Le-yuan, ZHANG Jian-hua, YUAN Tian-tian, CHEN Sheng-yong. Sequence-to-Sequence Chinese Continuous Sign Language Recognition and Translation with Multi- layer Attention Mechanism Fusion [J]. Computer Science, 2022, 49(9): 155-161.
[2] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[3] CHEN Yong-quan, JIANG Ying. Analysis Method of APP User Behavior Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(8): 78-85.
[4] ZHU Cheng-zhang, HUANG Jia-er, XIAO Ya-long, WANG Han, ZOU Bei-ji. Deep Hash Retrieval Algorithm for Medical Images Based on Attention Mechanism [J]. Computer Science, 2022, 49(8): 113-119.
[5] ZHANG Yuan, KANG Le, GONG Zhao-hui, ZHANG Zhi-hong. Related Transaction Behavior Detection in Futures Market Based on Bi-LSTM [J]. Computer Science, 2022, 49(7): 31-39.
[6] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[7] ZENG Zhi-xian, CAO Jian-jun, WENG Nian-feng, JIANG Guo-quan, XU Bin. Fine-grained Semantic Association Video-Text Cross-modal Entity Resolution Based on Attention Mechanism [J]. Computer Science, 2022, 49(7): 106-112.
[8] DAI Zhao-xia, LI Jin-xin, ZHANG Xiang-dong, XU Xu, MEI Lin, ZHANG Liang. Super-resolution Reconstruction of MRI Based on DNGAN [J]. Computer Science, 2022, 49(7): 113-119.
[9] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[10] LIU Yue-hong, NIU Shao-hua, SHEN Xian-hao. Virtual Reality Video Intraframe Prediction Coding Based on Convolutional Neural Network [J]. Computer Science, 2022, 49(7): 127-131.
[11] XU Ming-ke, ZHANG Fan. Head Fusion:A Method to Improve Accuracy and Robustness of Speech Emotion Recognition [J]. Computer Science, 2022, 49(7): 132-141.
[12] LIU Wei-ye, LU Hui-min, LI Yu-peng, MA Ning. Survey on Finger Vein Recognition Research [J]. Computer Science, 2022, 49(6A): 1-11.
[13] WU Zi-bin, YAN Qiao. Projected Gradient Descent Algorithm with Momentum [J]. Computer Science, 2022, 49(6A): 178-183.
[14] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[15] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!