Computer Science ›› 2019, Vol. 46 ›› Issue (6A): 215-221.

• Pattern Recognition & Image Processing • Previous Articles     Next Articles

Clothing Image Retrieval Method Combining Convolutional Neural Network Multi-layerFeature Fusion and K-Means Clustering

HOU Yuan-yuan, HE Ru-han, LI Min, CHEN Jia   

  1. Engineering Research Center of Hubei Province for Clothing Information,Wuhan Textile University,Wuhan 430200,China
  • Online:2019-06-14 Published:2019-07-02

Abstract: The booming of clothing e-commerce has accumulated a large amount of clothing image data,and the “image search” of clothing images has become a hot research direction.Apparel images have rich overall semantic information and a large amount of detailed information,and achieving accurate retrieval is a challenging problem.Traditional me-thods of clothing image based on artificial semantic annotation and methods of image retrieval based on artificially designed content features such as color and texture have significant limitations.This paper proposed a clothing image retrieval method based on multi-layer feature fusion and K-Means clustering of convolutional neural networks,which makes full use of the effectiveness and hierarchy of deep convolutional neural network in image feature extraction,fuses the detailed information and abstract semantic information of different convolutional hierarchical featuresto improve retrieval accuracy,and uses K-Means to improve the retrieval speed.The proposed method firstly performs uniform size processing on the clothing image data set,then uses the convolutional neural network for training and feature extraction,extracts multi-level features of the clothing image from low to high,and then fuses various levels of features.Finally,the K-Means clustering method is used to efficiently retrieve large-scale image data.The experimental results on the DeepFashion sub-category data set Category and Attribute Prediction Benchmark and In-shop Clothes Retrieval Benchmark show that the proposed method can effectively enhance the feature expression ability of clothing images,and improve its retrieval accuracy and retrieval speed.The proposed method is supprior to other mainstream methods.

Key words: Clothing image retrieval, Convolution neural network, Feature fusion, K-Means clustering

CLC Number: 

  • TP183
[1]ALBIOL A,MONZO D,MARTIN A,et al.Face recognition using HOG-EBGM[J].Pattern Recognition Letters,2008,29(10):1537-1543.
[2]LO T W R,SIEBERT J P.Local feature extraction and matching on range images:2.5D SIFT[J].Computer Vision & Image Understanding,2009,113(12):1235-1250.
[3]ZHOU L,GENG Z,ZHANG J,et al.ORB feature based web pornographic image recognition[J].Neurocomputing,2016,173(P3):511-517.
[4]贾巧丽,王娟,孔兵.基于形状特征和颜色的服装图像检索[J].现代计算机(专业版),2011(7):30-32.
[5]薛培培,邬延辉.基于图像内容和支持向量机的服装图像检索方法研究[J].移动通信,2016(2):79-82.
[6]胡玉平,肖行,罗东俊.基于GrabCut改进算法的服装图像检索方法[J].计算机科学,2016,43(S2):242-246.
[7]HINTON G,OSINDERO S.A fast learning algorithm for deep belief nets [J].Neural Computation,2006,18(7):1527-1554.
[8]CIRESAN D,MEIER U,SCHMIDHUBER J.Multi-column Deep Neural Networks for Image Classification [C]∥Procee-dings of IEEE Conference on Computer Vision and Pattern Re-cognition.Washington D C,USA:IEEE Press,2012:3642-3649.
[9]CIRSHICK R,DONAHUE J,DARRELL T,et al.Rich Feature Hierarchies for Accurate Object Detection and Semantic Segmentation [C]∥Proceedings of IEEE Conference on Computer Vision and Pattern Recognition.Washington D C,USA:IEEE Press,2014:580-587.
[10]LIN K,YANG H F,LIU K H,et al.Rapid clothing retrieval via deep learning of binary codes and hierarchical search[C]∥Proceedings of the 5th ACM on International Conference on Multimedia Retrieval.ACM,2015:498-502.
[11]KRIZHECSY A,SUTSKEVER I,HINTON G E.ImageNet classification with deep convolutional neural networks[C]∥Advances in Neural Information Processing Systems,2012,25(2):1097-1105.
[12]KIAPOU M H,HAN X,LAZEBNIK S,et al.Where to Buy It:Matching Street Clothing Photos in Online Shopes[C]∥2015 IEEE International Conference on Computer Vision(ICCV).Santiago:IEEE,2015:3343-3351.
[13]FUKUSHIMA K.Neocognitron:a self-organizing neural net-work model for a mechanism of pattern recognition unaffected by shift in position [J].Biological Cybernetics,1980,36(4):193-202.
[14]王利华,邹俊忠,张见,等.基于深度卷积神经网络的快速图像分类算法[J].计算机工程与应用,2017,53(13):181-188.
[15]刘海龙,李宝安,吕学强,等.基于深度卷积神经网络的图像检索算法研究[J].计算机应用研究,2017,34(12):3816-3819.
[16]YIM J,JU J,JUNG H,et al.Image Classification Using Convolutional Neural Networks With Multi-stage Feature [M]∥Robot Intelligence Technology and Applications 3.Springer International Publishing,2015.
[17]SZEGEDY C,LIU W,JIA Y,et al.Going deeper with convolutions[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston:IEEE,2015.
[18]SIMONYAN K,ZISSERMAN A.Very Deep Convolutional Networks for Large-Scale Image Recognition[J].Computer Science,2014,1(2):3.
[19]HE K,ZHANG X,REN S,et al.Deep Residual Learning for Ima-ge Recognition [C]∥2016 IEEE Conference on Computer Vision and Pattern Recognition(CVPR).IEEE Computer Society,2016:770-778.
[20]SCHROFF F,KALENICHENKO D,PHILBIN J.FaceNet:A unified embedding for face recognition and clustering[C]∥2015 IEEE Conference on Computer Vision and Pattern Recognition (CVPR).Boston:IEEE,2015:815-823.
[21]SURAL S,QIAN G,PRAMANIK S.Segmentation and histogram generation using the HSV color space for image retrieval[C]∥International Conference on Image Processing.IEEE,2002:589-592.
[22]DALAL N,TRIGGS B.Histograms of oriented gradients for human detection[C]∥IEEE Computer Society Conference on Computer Vision and Pattern Recognition.IEEE,2005:886-893.
[23]CHANG C C,LIN C J.LIBSVM:A library for support vector machines[J].ACM Transactions on Intelligent Systems and Technology,2011,2(3):1-27.
[1] ZHANG Ying-tao, ZHANG Jie, ZHANG Rui, ZHANG Wen-qiang. Photorealistic Style Transfer Guided by Global Information [J]. Computer Science, 2022, 49(7): 100-105.
[2] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[3] YU Shu-hao, ZHOU Hui, YE Chun-yang, WANG Tai-zheng. SDFA:Study on Ship Trajectory Clustering Method Based on Multi-feature Fusion [J]. Computer Science, 2022, 49(6A): 256-260.
[4] YANG Yue, FENG Tao, LIANG Hong, YANG Yang. Image Arbitrary Style Transfer via Criss-cross Attention [J]. Computer Science, 2022, 49(6A): 345-352.
[5] WANG Shan, XU Chu-yi, SHI Chun-xiang, ZHANG Ying. Study on Cloud Classification Method of Satellite Cloud Images Based on CNN-LSTM [J]. Computer Science, 2022, 49(6A): 675-679.
[6] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[7] SUN Jie-qi, LI Ya-feng, ZHANG Wen-bo, LIU Peng-hui. Dual-field Feature Fusion Deep Convolutional Neural Network Based on Discrete Wavelet Transformation [J]. Computer Science, 2022, 49(6A): 434-440.
[8] LAN Ling-xiang, CHI Ming-min. Remote Sensing Change Detection Based on Feature Fusion and Attention Network [J]. Computer Science, 2022, 49(6): 193-198.
[9] LI Fa-guang, YILIHAMU·Yaermaimaiti. Real-time Detection Model of Insulator Defect Based on Improved CenterNet [J]. Computer Science, 2022, 49(5): 84-91.
[10] DONG Qi-da, WANG Zhe, WU Song-yang. Feature Fusion Framework Combining Attention Mechanism and Geometric Information [J]. Computer Science, 2022, 49(5): 129-134.
[11] LI Peng-zu, LI Yao, Ibegbu Nnamdi JULIAN, SUN Chao, GUO Hao, CHEN Jun-jie. Construction and Classification of Brain Function Hypernetwork Based on Overlapping Group Lasso with Multi-feature Fusion [J]. Computer Science, 2022, 49(5): 206-211.
[12] FAN Xin-nan, ZHAO Zhong-xin, YAN Wei, YAN Xi-jun, SHI Peng-fei. Multi-scale Feature Fusion Image Dehazing Algorithm Combined with Attention Mechanism [J]. Computer Science, 2022, 49(5): 50-57.
[13] GAO Xin-yue, TIAN Han-min. Droplet Segmentation Method Based on Improved U-Net Network [J]. Computer Science, 2022, 49(4): 227-232.
[14] XU Tao, CHEN Yi-ren, LYU Zong-lei. Study on Reflective Vest Detection for Apron Workers Based on Improved YOLOv3 Algorithm [J]. Computer Science, 2022, 49(4): 239-246.
[15] XU Hua-jie, QIN Yuan-zhuo, YANG Yang. Scene Recognition Method Based on Multi-level Feature Fusion and Attention Module [J]. Computer Science, 2022, 49(4): 209-214.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!