Computer Science ›› 2024, Vol. 51 ›› Issue (6A): 230300236-6.doi: 10.11896/jsjkx.230300236

• Image Processing & Multimedia Technolog • Previous Articles     Next Articles

Person Re-identification Method Based on Multi-scale Local Feature Fusion

WU Lei, WANG Hairui, ZHU Guifu, ZHAO Jianghe   

  1. Faculty of Information Engineering and Automation,Kunming University of Science and Technology,Kunming 650500,China
  • Published:2024-06-06
  • About author:WU Lei,born in 1996,postgraduate.Her main research interests include computer vision and person re-identification.
    WANG Hairui,born in 1969,Ph.D,professor,Ph.D supervisor.His main research interests include multimedia intelligent technology,embedded application technology,etc.
  • Supported by:
    National Natural Science Foundation of China(61863016,61263023).

Abstract: Aiming at the problems of feature misalignment,ignoring semantic correlation between adjacent regions,background clutter and low training efficiency when extracting pedestrian features in existing person re-identification methods,a multi-scale local feature fusion method is proposed.Firstly,the spatial transformation network is introduced to perform adaptive affine transformation on the image to realize the alignment of pedestrian spatial features.Secondly,the feature maps of different scales are segmented horizontally,and the adjacent local blocks are spliced in different ways to make up for the lack of correlation information of adjacent blocks caused by cutting.Then,the correlation between global features and local features is mined.At the same time,the random erasure method is incorporated to process the data set to prevent the model from overfitting.And a variety of loss functions are used to train the network model to improve the intra-class compactness and inter-class diversity of the model.Finally,experiments are carried out on Market-1501 and DukeMTMC-ReID datasets,the Rank-1 reaches 95.0% and 88.8%,and the mAP reaches 89.2% and 78.9%,respectively.The results show that the proposed method can extract more discriminative pedestrian features.

Key words: Person re-identification, Local feature, Feature space segmentation, Spatial transformation network, Random erasure

CLC Number: 

  • TP391
[1]MING Z,ZHU M,WANG X,et al.Deep learning-based person re-identification methods:A survey and outlook of recent works[J].Image and Vision Computing,2022,119:104394.
[2]YAO Z,GONG X,CHEN R,et al.Research progress,challenge and prospect of local features for person re-identification[J].Acta Automatica Sinica,2021,47(12):2742-2760.
[3]ZHAO H,TIAN M,SUN S,et al.Spindle net:Person re-identification with human body region guided feature decomposition and fusion[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2017:1077-1085.
[4]MIAO J,WU Y,LIU P,et al.Pose-guided feature alignment for occluded person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:542-551.
[5]LIU J,NI B,YAN Y,et al.Pose transferrable person re-identifi-cation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:4099-4108.
[6]PANG Y X,ZHANG H X,ZHU L,et al.Feature generation based on relation learning and image partition for occluded person re-identification[J].Journal of Visual Communication and Image Representation,2023,91.
[7]SUN Y,ZHENG L,YANG Y,et al.Beyond part models:Person retrieval with refined part pooling(and a strong convolutional baseline)[C]//Proceedings of the European Conference on Computer Vision(ECCV).2018:480-496.
[8]WANG G,YUAN Y,CHEN X,et al.Learning discriminativefeatures with multiple granularities for person re-identification[C]//Proceedings of the 26th ACM International Conference on Multimedia.2018:274-282.
[9]FU Y,WEI Y,WANG G,et al.Self-similarity grouping:A simple unsupervised cross domain adaptation approach for person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:6112-6121.
[10]ZHENG F,DENG C,SUN X,et al.Pyramidal person re-identification via multi-loss dynamic training[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:8514-8522.
[11]HU J,SHEN L,SUN G.Squeeze-and-excitation networks[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.Utah,USA:IEEE,2018:7132-7141.
[12]CAI H,WANG Z,CHENG J.Multi-scale body-part maskguided attention for person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops.2019.
[13]LI W,ZHU X,GONG S.Harmonious attention network for person re-identification[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.2018:2285-2294.
[14]CHEN T,DING S,XIE J,et al.ABD-Net:Attentive but Diverse Person Re-Identification[J].arXiv:2019.00844,2019.
[15]ZHANG G Q ,LIN W S,CHANDRAN A K,et al.Complementary networks for person re-identification[J]Information Sciences,2023,633.
[16]MENG Y B,MU S R,LIU G H,et al.Person re-identification method based on GoogLeNet-GMP based on vector Attention mechanism[J].Computer Science,2022,49(7):142-147.
[17]JADERBERG M,SIMONYAN K,ZISSERMAN A.Spatialtransformer networks[C]//Advances in Neural Information Processing Systems.2015:2017-2025.
[18]LIU L,LI X,LEI X M.A Person Re-Identification Method with Multi-Scale and Multi-Feature Fusion[J].Journal of Computer-Aided Design & Computer Graphics,2022,34(12):1868-1876.
[19]LUO H,JIANG W,ZHANG X,et al.Alignedreid+ +:Dynamic-ally matching local information for person re-identification[J].Pattern Recognition,2019,94:53-61.
[20]LI S S,LIU X L,ZHAO Y,et al.Person re-identification based on multi-scale constraint network[J].Pattern Recognition Letters,2020,138:403-409.
[21]ZHANG W F,HUANG L,WEI Z Q,et al.Appearance feature enhancement for person re-identification[J].Expert Systems with Applications,2021,163:113771.
[22]ZHOU K Y,YANG Y X,CAVALLARO A,et al.Omni-scale feature learning for person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.Los Alamitos:IEEE Computer Society Press,2019:3701-3711.
[1] LOU Ren, HE Renqiang, ZHAO Sanyuan, HAO Xin, ZHOU Yueqi, WANG Xinyuan, LI Fangfang. Single Stage Unsupervised Visible-infrared Person Re-identification [J]. Computer Science, 2024, 51(6A): 230600138-7.
[2] ZHAO Jiangfeng, HE Hongjie, CHEN Fan, YANG Shubin. Two-stage Visible Watermark Removal Model Based on Global and Local Features for Document Images [J]. Computer Science, 2024, 51(2): 172-181.
[3] DAI Xuesong, LI Xiaohong, ZHANG Jingjing, QI Meibin, LIU Yimin. Unsupervised Domain Adaptive Pedestrian Re-identification Based on Counterfactual AttentionLearning [J]. Computer Science, 2023, 50(7): 160-166.
[4] WU Hanxiao, ZHAO Qianqian, ZHU Jianqing, ZENG Huanqiang, DU Jixiang, LIAO Yun. Metric Regularized Infrared and Visible Cross-modal Person Re-identification [J]. Computer Science, 2023, 50(6A): 221100046-8.
[5] ZHANG Shuaiyu, PENG Li, DAI Feifei. Person Re-identification Method Based on Progressive Attention Pyramid [J]. Computer Science, 2023, 50(6A): 220200084-8.
[6] LIU Songyue, WANG Huan. Leaf Classification and Ranking Method Based on Multi-granularity Feature Fusion [J]. Computer Science, 2023, 50(3): 216-222.
[7] CHEN Qiaosong, WU Jiliang, JIANG Bo, TAN Chongchong, SUN Kaiwei, DEN Xin, WANG Jin. Coupling Local Features and Global Representations for 2D Human Pose Estimation [J]. Computer Science, 2023, 50(11A): 221100007-5.
[8] CHEN Kun-feng, PAN Zhi-song, WANG Jia-bao, SHI Lei, ZHANG Jin. Moderate Clothes-Changing Person Re-identification Based on Bionics of Binocular Summation [J]. Computer Science, 2022, 49(8): 165-171.
[9] LI Zong-min, ZHANG Yu-peng, LIU Yu-jie, LI Hua. Deformable Graph Convolutional Networks Based Point Cloud Representation Learning [J]. Computer Science, 2022, 49(8): 273-278.
[10] MENG Yue-bo, MU Si-rong, LIU Guang-hui, XU Sheng-jun, HAN Jiu-qiang. Person Re-identification Method Based on GoogLeNet-GMP Based on Vector Attention Mechanism [J]. Computer Science, 2022, 49(7): 142-147.
[11] YANG Xiao-yu, YIN Kang-ning, HOU Shao-qi, DU Wen-yi, YIN Guang-qiang. Person Re-identification Based on Feature Location and Fusion [J]. Computer Science, 2022, 49(3): 170-178.
[12] ZHANG Min, YU Zeng, HAN Yun-xing, LI Tian-rui. Overview of Person Re-identification for Complex Scenes [J]. Computer Science, 2022, 49(10): 138-150.
[13] ZHANG Xin-feng, SONG Bo. A Person Re-identification Method Based on Improved Triple Loss and Feature Fusion [J]. Computer Science, 2021, 48(9): 146-152.
[14] DONG Hu-sheng, ZHONG Shan, YANG Yuan-feng, SUN Xun, GONG Sheng-rong. Person Re-identification by Region Correlated Deep Feature Learning with Multiple Granularities [J]. Computer Science, 2021, 48(12): 269-277.
[15] TANG Yi-xing, LIU Xue-liang, HU She-jiao. Multi-orientation Partitioned Network for Person Re-identification [J]. Computer Science, 2021, 48(10): 204-211.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!