Computer Science ›› 2021, Vol. 48 ›› Issue (12): 269-277.doi: 10.11896/jsjkx.210400121

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Person Re-identification by Region Correlated Deep Feature Learning with Multiple Granularities

DONG Hu-sheng1,2, ZHONG Shan3, YANG Yuan-feng1,2, SUN Xun1,2, GONG Sheng-rong3   

  1. 1 Jiangsu Province Support Software Engineering R & D Center for Modern Information Technology Application in Enterprise,Suzhou,
    Jiangsu 215104,China
    2 School of Computer Engineering,Suzhou Vocational University,Suzhou,Jiangsu 215104,China
    3 School of Computer Science and Engineering,Changshu Institute of Technology,Changshu,Jiangsu 215500,China
  • Received:2021-04-13 Revised:2021-07-25 Online:2021-12-15 Published:2021-11-26
  • About author:DONG Hu-sheng,born in 1981,Ph.D,lecturer,is a member of China Compu-ter Federation.His main research in-terests include computer vision,machine learning,and deep learning.
  • Supported by:
    National Natural Science Foundation of China(61702055,61972059,61773272),Natural Science Foundation of Jiangsu Province(BK20191474,BK20191475,BK20161268) and Research Funds of Suzhou Vocational University(SVU2021YY03).

Abstract: Extracting both global and local features from pedestrian images has become the mainstream inperson re-identification.While among most of current deep learning based person re-identification models,the relations between adjacent body parts are seldom taken into consideration during extracting local features.This may decay the capability of distinguishing different persons when they share similar attributes of local regions.To address this problem,a novel method is proposed to learn region correlated deep features for person re-identification.In our model,the output feature map of backbone network is partitioned with multiple granularities first.And then the structure information preserved local features are learned via a new designed Region Correlated Network (RCNet) module.The RCNet makes full use of the structure maintenance of average pooling and the performance advantage of max pooling,endowing local features with rich structural information.By jointly processing current feature and local features from other regions,they are strongly related to each other due to the spatial correlation.As a result,the discrimination of them is significantly enhanced.For better optimization of the whole network,the shortcut connection in deep residual networks is also employed in the architecture of RCNet.Finally,the re-identification is conducted with both global features and the local features with structural information incorporated.Experimental results show that the proposed method achieves higher matching accuracies in comparison with existing approaches on the public Market-1501,CUHK03 and DukeMTMC-reID datasets,demonstrating favorable re-identification performance.

Key words: Deep Learning, Feature representation, Person re-identification, Pooling operation, Region correlated network

CLC Number: 

  • TP391
[1]KHAWAR I.Person Search:New Paradigm of Person Re-Identification:A Survey And Outlook of Recent Works [J].Image and Vision Computing,2020,101:1-11.
[2]SRIKRISHNAK,GOU M R,WU Z Y,et al.A Systematic Eva- luation And Benchmark for Person Re-Identification:Features,Metrics,And Datasets [J].IEEE Transactions on Pattern Ana-lysis and Machine Intelligence,2018,41(3):523-536.
[3]LECUN Y,BENGIO Y,HINTON G.Deep learning [J].Nature,2015,521(7553):436-444.
[4]LI W,ZHAO R,XIAO T,et al.DeepReID:Deep Filter Pairing Neural Network for Person Re-identification[C]//IEEE Confe-rence on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2014:152-159.
[5]ZHENG L,SHEN L Y,TIAN L,et al.Scalable Person Re-identification:A Benchmark[C]//IEEE International Conference On Computer Vision (ICCV).IEEE Computer Society,2015:1116-1124.
[6]SUN Y F,ZHENG L,DENG W J,et al.SVDNet for Pedestrian Retrieval[C]//IEEE International Conference on Computer Vision (ICCV).IEEE Computer Society,2017:3800-3808.
[7]LUO H,JIANG W,ZHANG X,et al.AlignedReID++:Dynamically Matching Local Information for Person Re-Identification [J].Pattern Recognition,2019,94:53-61.
[8]WANG G S,YUAN Y F,CHEN X,et al.Learning Discriminative Features with Multiple Granularities for Person Re-identification[C]//ACM International Conference on Multimedia.2018:274-282.
[9]SUN Y F,ZHENG L,YANG Y,et al.Beyond Part Models:Per- son Retrieval with Refined Part Pooling (and A Strong Convolutional Baseline)[C]//European Conference on Computer Vision (ECCV).2018:480-496.
[10]YE M,SHEN J B,LIN G J,et al.Deep Learning for Person Re-Identification:A Survey And Outlook[J].arXiv:2001.04193v1.
[11]XIAO T,LI H S,OUYANG W L,et al.Learning Deep Feature Representations with Domain Guided Dropout for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2016:1249-1258.
[12]ZHENG F,DENG C,SUN X,et al.Pyramidal Person Re-identification via Multi-loss Dynamic Training[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2019:8514-8522.
[13]ZHANG Z Z,LAN C L,ZENG W J,et al.Densely Semantically Aligned Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2019:667-676.
[14]HE K M,ZHANG X Y,REN S Q,et al.Deep Residual Learning For Image Recognition[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2016:770-778.
[15]ZHENG Z D,ZHENG L,YANG Y.Unlabeled Samples Generated by GAN Improve the Person Re-identification Baseline in Vitro[C]//IEEE International Conference on Computer Vision (ICCV).IEEE Computer Society,2017:3754-3762.
[16]AHMED E,JONES M,MARKS T K.An Improved Deep Learning Architecture for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2015:3908-3916.
[17]HOU R B,MA B P,CHANG H,et al.Interaction-and-aggregation Network for Person Re-identification[C]//IEEE Confe-rence on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2019:9317-9326.
[18]CHENG D,GONG Y H,ZHOU S P,et al.Person Re-identification by Multi-channel Parts-based CNN with Improved Triplet Loss Function[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2016:1335-1344.
[19]SUN Y F,XU Q,LI Y L,et al.Perceive Where To Focus:Learning Visibility-aware Part-level Features for Partial Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2019:393-402.
[20]WANG G S,YUAN Y F,LI J W,et al.Receptive Multi-granularity Representation for Person Re-Identification[J].IEEE Transaction on Image Processing,2020,29:6096-6109.
[21]SONG C F,HUANG Y,OUYANG W L,et al.Mask-guided Contrastive Attention Model for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2018:1179-1188.
[22]XU J,ZHAO R,ZHU F,et al.Attention-aware Compositional Network for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2018:2119-2128.
[23]ZHAO H Y,TIAN M Q,SUN S Y,et al.Spindle Net:Person Re-identification with Human Body Region Guided Feature Decomposition and Fusion[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2017:1077-1085.
[24]CHEN X S,FU C M,ZHAO Y.Salience-Guided Cascaded Suppression Network for Person Re-identification [C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2020:3300-3310.
[25]MIAO J X,WU Y,LIU P,et al.Pose-guided Feature Alignment for Occluded Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2019:542-551.
[26]ZHANG Z Z,LAN C L,ZENG W J,et al.Relation-Aware Glo- bal Attention for Person Re-identification[C]//IEEE Confe-rence on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2020:3186-3195.
[27]FU Y,WEI Y C,ZHOU Y Q,et al.Horizontal Pyramid Matching for Person Re-identification[C]//AAAI Conference on Artificial Intelligence.2019,33:8295-8302.
[28]PARK H,HAM B.Relation Network for Person Re-identification[C]//AAAI Conference on Artificial Intelligence.2020:11839-11847.
[29]HERMANS A,BEYER L,LEIBE B.In defense of the triplet loss for person re-identification [J].arXiv:1703.07737.
[30]ZHONG Z,ZHENG L,CAO D L,et al.Re-ranking Person Re-identification with K-reciprocal Encoding[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2017:1318-1327.
[31]DENG J,DONG W,SOCHER R,et al.ImageNet:A Large-scale Hierarchical Image Database[C]//IEEE Conference on Compu-ter Vision and Pattern Recognition (CVPR).IEEE Computer Society,2009:248-255.
[32]ZHONG Z,ZHENG L,KANG G L,et al.Random Erasing Data Augmentation[C]//AAAI Conference on Artificial Intelligence.2020:13001-13008.
[33]LUO H,JIANG W,GU Y Z,et al.A Strong Baseline and Batch Normalization Neck for Deep Person Re-Identification [J].IEEE Transactions on Multimedia,2020,22(10):2597-2609.
[34]LI W,ZHU X T,GONG S G.Harmonious Attention Network for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2018:2285-2294.
[35]SARFRAZ M S,SCHUMANN A,EBERLE A,et al.A Pose-sensitive Embedding for Person Re-identification with Expanded Cross Neighborhood Re-ranking[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2018:420-429.
[36]ZHAO L M,LI X,ZHUANG Y T,et al.Deeply-learned Part- aligned Representations for Person Re-identification[C]//IEEE Conference on Computer Vision and Pattern Recognition (CVPR).IEEE Computer Society,2017:3219-3228.
[1] XU Yong-xin, ZHAO Jun-feng, WANG Ya-sha, XIE Bing, YANG Kai. Temporal Knowledge Graph Representation Learning [J]. Computer Science, 2022, 49(9): 162-171.
[2] RAO Zhi-shuang, JIA Zhen, ZHANG Fan, LI Tian-rui. Key-Value Relational Memory Networks for Question Answering over Knowledge Graph [J]. Computer Science, 2022, 49(9): 202-207.
[3] TANG Ling-tao, WANG Di, ZHANG Lu-fei, LIU Sheng-yun. Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy [J]. Computer Science, 2022, 49(9): 297-305.
[4] CHEN Kun-feng, PAN Zhi-song, WANG Jia-bao, SHI Lei, ZHANG Jin. Moderate Clothes-Changing Person Re-identification Based on Bionics of Binocular Summation [J]. Computer Science, 2022, 49(8): 165-171.
[5] SUN Qi, JI Gen-lin, ZHANG Jie. Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection [J]. Computer Science, 2022, 49(8): 172-177.
[6] WANG Jian, PENG Yu-qi, ZHAO Yu-fei, YANG Jian. Survey of Social Network Public Opinion Information Extraction Based on Deep Learning [J]. Computer Science, 2022, 49(8): 279-293.
[7] HAO Zhi-rong, CHEN Long, HUANG Jia-cheng. Class Discriminative Universal Adversarial Attack for Text Classification [J]. Computer Science, 2022, 49(8): 323-329.
[8] JIANG Meng-han, LI Shao-mei, ZHENG Hong-hao, ZHANG Jian-peng. Rumor Detection Model Based on Improved Position Embedding [J]. Computer Science, 2022, 49(8): 330-335.
[9] HOU Yu-tao, ABULIZI Abudukelimu, ABUDUKELIMU Halidanmu. Advances in Chinese Pre-training Models [J]. Computer Science, 2022, 49(7): 148-163.
[10] ZHOU Hui, SHI Hao-chen, TU Yao-feng, HUANG Sheng-jun. Robust Deep Neural Network Learning Based on Active Sampling [J]. Computer Science, 2022, 49(7): 164-169.
[11] SU Dan-ning, CAO Gui-tao, WANG Yan-nan, WANG Hong, REN He. Survey of Deep Learning for Radar Emitter Identification Based on Small Sample [J]. Computer Science, 2022, 49(7): 226-235.
[12] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[13] CHENG Cheng, JIANG Ai-lian. Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction [J]. Computer Science, 2022, 49(7): 120-126.
[14] MENG Yue-bo, MU Si-rong, LIU Guang-hui, XU Sheng-jun, HAN Jiu-qiang. Person Re-identification Method Based on GoogLeNet-GMP Based on Vector Attention Mechanism [J]. Computer Science, 2022, 49(7): 142-147.
[15] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!