Computer Science

Computer Science ›› 2023, Vol. 50 ›› Issue (3): 223-230.doi: 10.11896/jsjkx.211200110

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Classification of Oil Painting Art Style Based on Multi-feature Fusion

XIE Qinqin, HE Lang, XU Ruli   

  1. School of Science,Wuhan University of Technology,Wuhan 430070,China
  • Received:2021-12-09 Revised:2022-04-18 Online:2023-03-15 Published:2023-03-15
  • About author:XIE Qinqin,born in 1997,postgra-duate.Her main research interests include image processing and so on.
    HE Lang,born in 1974,Ph.D,professor.His main research interests include intelligent calculation and image processing.
  • Supported by:
    National Natural Science Foundation of China(61672391).

PDF (PC)

308

Abstract: The existing oil painting art style classification algorithms ignore the influence of the main area and the overall effect on the art style.Aiming at this problem,this paper proposes a new oil painting classification algorithm based on multi-feature fusion classifier(MFFC).Firstly,based on the common arrangement form of oil painting art elements,this paper designs the overlapping image block method.This method extracts spatial features of oil paintings to make up for the lack of composition style in existing algorithms.And it also can be used to distinguish the subject area from the background area.Secondly,the spatial features and the underlying features are combined in series to increase the location information of the elements in the picture.Finally,the spatial voting method is designed to give priority to the classification result of the main area as the output result of the algorithm.This is to highlight the role of oil painting subject area in the classification and realize the automatic classification of oil painting art style.Tested on the data set created by the FS-classifier model,its accuracy,precision,recall,F1-score and AUC reaches 96.92%,63.69%,98.75%,98.57% and 0.917,respectively.Compared with FS-classifier,the result increases by 6.72%,5.85%,9.05%,7.1% and 0.128,respectively.When tested on WIKIART and compared with other six algorithms,the accuracy improves by 13.27%,at least.The results show that the proposed algorithm can effectively improve the performance of spatial features for oil painting art style classification task,and has good practical value.

Key words: Art style of oil painting, Image classification, Spatial feature, Feature fusion, Spatial voting

CLC Number: 

  • TP319
[1]BAI R Y,GUO X Y,JIA C H,et al.Overview of ResearchMethods of Painting Aesthetics[J].Journal of Image andGra-phics,2019,24(11):1860-1881.
[2]WANG X R,HUANG Z C.Painter Artistic Style ExtractionMethod Based on Color Features[J].Journal of Computer Applications,2020,40(6):1818-1823.
[3]FLOREA C,TOCA C,GIESEKE F.Artistic Movement Recognition by Boosted Fusion of Color Structure and Topographic Description[C]//Proceedings of 17th IEEE Winter Conference on Applications of Computer Vision.Santa Rosa:IEEE,2017:569-577.
[4]LAMBERTI F,SANA A,PARAVATI G.Computer assistedanalysis of painting brushstrokes:digital image processing for unsupervised extraction of visible features from van Gogh's works[J].EURASIP Journal on Image and Video Processing,2014,2014(1):1-17.
[5]LI J,YAO L,HENDRIKS E.Rhythmic brushstrokes distin-guish van Gogh from his contemporaries:findings via automated brushstroke extraction[J].IEEE Transactions on Pattern Ana-lysis and Machine Intelligence,2011,34(6):1159-1176.
[6]CHEN T,YANG J.A novel multi-feature fusion method in merging information of heterogenous-view data for oil painting image feature extraction and recognition[J/OL].Frontiers in Neurorobotics,2021,15:95.https://www.frontiersin.org/articles/10.3389/fnbot.2021.709043/full.
[7]LEVY E,DAVID O,NETANYAHU N S.Painter Classification Using Genetic Algorithms[C]//Congress on Evolutionary.Institute of Electrical and Electronics Engineers,New York:IEEE,2013:3027-3034.
[8]BAI R Y,GUO X Y,JIA C H.Research on Emotion of Abstract Painting Based on Multi-Feature Fusion[J].Application Research of Computer,2021,38(2):587-590.
[9]DONG X,LI G,JIA Y,et al.Multiscale feature extraction from the perspectiveof graph for hob fault diagnosis using spectral graph wavelet transform combined with improved random forest[J].Measurement,2021,176(2):109178.
[10]DU L,LI L,WANG B,et al.Micro-doppler Feature Extraction Based on Time-frequency Spectrogram for Ground Moving Targets Classification with Low-resolution Radar[J].IEEE Sensors Journal,2016,16(10):3756-3763.
[11]LU Y,GUO C,LIN Y L,et al.Computational Aesthetics of Fine Art Painting:The State of the Art and Outlook[J].Acta Automatica Sinica,2020,46(11):2239-2259.
[12]LU Z K.Research on Image retrieval based on color and spatial features[D].Quanzhou:Huaqiao University,2005.
[13]WIDJAJA I,LEOW W K,WU F C.Identifying Painters fromColor Profiles of Skin Patches in Painting Images[C]//Procee-dings of the 2003 International Conference on Image Processing.Piscataway:IEEE,2003:831-845.
[14]JIA C H,GUO X Y,BAI R Y.Review of Feature Extraction Methods and Research on Affective Analysis for Paintings[J].Journal of Image and Graphics,2018,23(7):937-952.
[15]JIANG X W,ZHANG M X,ZHU Z S.Recognition of Chinese Finger Sign Language Based on Gray Level Co-occurrence Matrix and Fine Gaussian Support Vector Machine[J].Computer Science,2019,46(S2):303-308.
[16]BISHOP C M.Pattern Recognition and Machine Learning[M].New York:Springer,2006:2-26.
[17]ZHANG H Y,ZHANG J,HUANG J.Multi-label Image Classification Model Based on Graph Attention Network[J].Journal of Chongqing Technology and Business University(Natural Science Edition),2022,39(1):34-41.
[18]WU J,XU J,DING T.Fine-grained Image Classification Algorithm Based on Ensemble Methods of Transfer Learning[J].Journal of Chongqing Technology and Business University(Na-tural Science Edition),2020,32(3):452-458.
[19]ZHOU X M,HU Y G,LIU W J,et al.Research on Urban Function Recognition Based on Multi-level Data Fusion Method[J].Computer Science,2021,48(9):50-58.
[20]WANG Z Y,ZHANG Y Z,LIU Y,et al.MFC-Net:Multi-feature fusion cross neural network for salient object detection[J].Image and Vision Computing,2021,113:104243.
[21]MUSBAH H,ALY H H,LITTLE T A.Energy management of hybrid energy system sources based on machine learning classification algorithms[J/OL].Electric Power Systems Research,2021,199:107436.https://www.sciencedirect.com/science/article/pii/S037877962100417X.
[22]HE X H,QIU F B,CHENG X J,et al.High-resolution Image Building Target Detection Based on Edge Feature Fusion[J].Computer Science,2021,48(9):140-145.
[23]AGARWAL S,KARNICKA H C,PANT N,et al.Genre and Style Based Painting Classification[C]//Winter Conference on Applications of Computer Vision.New York:IEEE,2015:588-594.
[24]HUANG X,ZHONG S H,XIAO Z.Fine-art painting classification via two-channel deep residual network[J].International Journal of Machine Learning and Cybernetics,2020,11(1):137-152.
[25]LECOUTRE A,NEGREVERGNE B,YEGR F.Recognizing Art Style Automatically in Painting with Deep Learning[C]//Proceeding of the 9th Asian Conference on Machine Learning.Seoul,Korea:PMLR,2017:327-342.
[26]ELGAMMAL A,MAZZONE M,LIU B,et al.The Shape of Art History in the Eyes of the Machine[C]//Proceedings of the AAAI Conference on Artificial Intelligence.Louisiana:AAAI Press,2018,32(1):2183-2191.
[27]CETINIC E,LIPIC T,GRGIC S.Fine-tuning ConvolutionalNeural Networks for Fine Art Classification[J].Expert Systems With Applications,2018,114(DEC.):107-118.
[28]SANDOVAL C,PIROGOVA E,LECH M.Two-stage DeepLearning Approach to the Classification of Fine-art Paintings[J/OL].IEEE Access,2019,7:41770-41781.https://ieeexplore.ieee.org/abstract/document/8675906.
[1] BAI Xuefei, MA Yanan, WANG Wenjian. Segmentation Method of Edge-guided Breast Ultrasound Images Based on Feature Fusion [J]. Computer Science, 2023, 50(3): 199-207.
[2] LIU Zejing, WU Nan, HUANG Fuqun, SONG You. Hybrid Programming Task Recommendation Model Based on Knowledge Graph and Collaborative Filtering for Online Judge [J]. Computer Science, 2023, 50(2): 106-114.
[3] ZOU Yunzhu, DU Shengdong, TENG Fei, LI Tianrui. Visual Question Answering Model Based on Multi-modal Deep Feature Fusion [J]. Computer Science, 2023, 50(2): 123-129.
[4] HUA Jie, LIU Xueliang, ZHAO Ye. Few-shot Object Detection Based on Feature Fusion [J]. Computer Science, 2023, 50(2): 209-213.
[5] ZHAO Qian, ZHOU Dongming, YANG Hao, WANG Changchen. Image Deblurring Based on Residual Attention and Multi-feature Fusion [J]. Computer Science, 2023, 50(1): 147-155.
[6] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[7] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[8] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[9] DU Li-jun, TANG Xi-lu, ZHOU Jiao, CHEN Yu-lan, CHENG Jian. Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning [J]. Computer Science, 2022, 49(6A): 60-65.
[10] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[11] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[12] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[13] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[14] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[15] LAN Ling-xiang, CHI Ming-min. Remote Sensing Change Detection Based on Feature Fusion and Attention Network [J]. Computer Science, 2022, 49(6): 193-198.
Viewed
Full text


Abstract

Cited
  Shared   
  Discussed   
No Suggested Reading articles found!
渝ICP备16013121号-4
Add:18# Honghu West Rd., Yubei ,Chongqing,China    Post Code: 401121
Tel: 023-63500828/023-67039612/023-67039623
E-mail: jsjkx12@163.com
Powered by Beijing Magtech Co., Ltd.