Computer Science ›› 2023, Vol. 50 ›› Issue (7): 160-166.doi: 10.11896/jsjkx.220600153

• Computer Graphics & Multimedia • Previous Articles     Next Articles

Unsupervised Domain Adaptive Pedestrian Re-identification Based on Counterfactual AttentionLearning

DAI Xuesong, LI Xiaohong, ZHANG Jingjing, QI Meibin, LIU Yimin   

  1. School of Computer Science and Information Engineering,Hefei University of Technology,Hefei 230601,China
  • Received:2022-06-16 Revised:2022-11-08 Online:2023-07-15 Published:2023-07-05
  • About author:DAI Xuesong,born in 1998,postgra-duate,is a member of China Computer Federation.His main research interests include computer vision and model compression.LI Xiaohong,born in 1970,postgra-duate,associate professor,master supervisor.Her main research interests include computer vision and model compression.
  • Supported by:
    National Natural Science Foundation of China(62172137) and Natural Science Foundation of Hefei,China(2021050).

Abstract: Most of the existing unsupervised domain adaptive pedestrian re-identification methods combine clustering-based pseudo-label prediction with feature fine-tuning.Due to the differences between domains,incorrect pseudo-labels are generated during the clustering process,making pseudo-labels unreliable to a certain extent,misleading feature representation learning,and affec-ting the performance of domain-adaptive models.First,a novel unsupervised domain adaptive network based on counterfactual attention learning is designed,which guides and optimizes the training process by measuring the quality of attention learning,prompting the model to focus on more accurate attention features and reducing the generation of noisy pseudo-labels.Secondly,a noisy samples optimization method based on uncertainty evaluation is proposed.By measuring the inconsistency level between the output features of the student model and the teacher model,as the uncertainty distribution of pedestrian samples in the target domain.The teacher model and the student model are both constructed based on the average teacher method.The uncertainty of the sample is used to reasonably weight each part of the overall loss of the network,and the erroneous influence of the sample with high uncertainty on the overall loss of the model is corrected,and the recognition performance of the target domain is further improved.Experimental data show that the proposed method significantly improves the experimental results in both the source domain DukeMTMC-reID/Market-1501 and the target domain Market-1501/DukeMTMC-reID,with mAP and Rank-1 reaching 82.9%,93.6% and 71.8%,84.4%,respectively.

Key words: Person re-identification, Unsupervised, Domain adaptive, Counterfactual attention, Uncertainty estimation

CLC Number: 

  • TP391
[1]FAN H,ZHENG L,YAN C,et al.Unsupervised person re-identification:Clustering and finetuning[J].ACM Transactions on Multimedia Computing,Communications,and Applications(TOMM),2018,14(4):1-18.
[2]FU Y,WEI Y,WANG G,et al.Self-similarity grouping:A simple unsupervised cross domain adaptation approach for person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:6112-6121.
[3]ZHANG X,CAO J,SHEN C,et al.Self-Training with progressive augmentation for unsupervised cross-domain person re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:8222-8231.
[4]JIN X,HE T,YIN Z,et al.Meta clustering learning for large-scale unsupervised person re-identification[J].arXiv:2111,10032,2021.
[5]GE Y,CHEN D,LI H,et al.Mutual mean-teaching:Pseudo label refinery for unsupervised domain adaptation on person re-identification[J].arXiv:2001.01526,2020.
[6]ZHAO F,LIAO S,XIE G,et al.Unsupervised domain adaptation with noise resistible mutual-training for person re-identification[C]//European Conference on Computer Vision.Springer,2020:526-544.
[7]HE K,FAN H,WU Y,et al.Momentum contrast for unsuper-vised visual representation learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:9729-9738.
[8]ZHONG Z,ZHENG L,LUO Z,et al.Invariance matters:Exemplar memory for domain adaptive person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:598-607.
[9]LIU J,ZHA Z J,CHEN D,et al.Adaptive transfer network for cross-domain person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:7202-7211.
[10]SONG L,WANG C,ZHANG L,et al.Unsupervised domainadaptive re-identification:Theory and practice[J].Pattern Recognition,2020,102:107173.
[11]ZHAI Y,LU S,YE Q,et al.Ad-cluster:Augmented discriminative clustering for domain adaptive person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:9021-9030.
[12]ZHENG K,LAN C,ZENG W,et al.Exploiting sample uncertainty for domain adaptive person re-identification[J].arXiv:2012.08733,2020.
[13]ZHENG K,LIU W,HE L,et al.Group-aware label transfer for domain adaptive person re-identification[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2021:5310-5319.
[14]PEARL J.Direct and indirect effects[M].Probabilistic andCausal Inference:The Works of Judea Pearl.2022:373-392.
[15]VANDERWEELE T.Explanation in causal inference:Developments in mediation and interaction[J].International Journal of Epidemiology,2016,45(6):1904-1908.
[16]KENDALL A,GAL Y.What uncertainties do we need in baye-sian deep learning for computer vision?[J].arXiv:1703.04977,2017.
[17]RAO Y,CHEN G,LU J,et al.Counterfactual attention learning for fine-grained visual categorization and re-identification[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2021:1025-1034.
[18]VANDERWEELE T.Explanation in causal inference:methodsfor mediation and interaction[M].NewYork:Oxford University Press,2015.
[19]ZHENG L,SHEN L,TIAN L,et al.Scalable person re-identification:A benchmark[C]//Proceedings of the IEEE Interna-tional Conference on Computer Vision.2015:1116-1124.
[20]RISTANI E,SOLERA F,ZOU R,et al.Performance measures and a data set for multi-target,multi-camera tracking[C]//European Conference on Computer Vision.Springer,2016:17-35.
[21]LIN Y,DONG X,ZHENG L,et al.A bottom-up clustering approach to unsupervised person re-identification[C]//Procee-dings of the AAAI Conference on Artificial Intelligence.2019:8738-8745.
[22]YU H,ZHENG W,WU A,et al.Unsupervised person re-identification by soft multilabel learning[C]//Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2019:2148-2157.
[23]LI Y,LIN C,LIN Y,et al.Cross-dataset person re-identification via unsupervised pose disentanglement and adaptation[C]//Proceedings of the IEEE/CVF International Conference on Computer Vision.2019:7919-7929.
[24]WANG D,ZHANG S.Unsupervised person re-identification via multi-label classification[C] //Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition.2020:10981-10990.
[25]HUANG Y,PENG P,JIN Y,et al.Domain adaptiveattention model for unsupervised cross-domain person re-identification[J].arXiv:1905.10529,2019.
[1] LIANG Yunhui, GAN Jianwen, CHEN Yan, ZHOU Peng, DU Liang. Unsupervised Feature Selection Algorithm Based on Dual Manifold Re-ranking [J]. Computer Science, 2023, 50(7): 72-81.
[2] WU Hanxiao, ZHAO Qianqian, ZHU Jianqing, ZENG Huanqiang, DU Jixiang, LIAO Yun. Metric Regularized Infrared and Visible Cross-modal Person Re-identification [J]. Computer Science, 2023, 50(6A): 221100046-8.
[3] ZHANG Shuaiyu, PENG Li, DAI Feifei. Person Re-identification Method Based on Progressive Attention Pyramid [J]. Computer Science, 2023, 50(6A): 220200084-8.
[4] WANG Qingyu, WANG Hairui, ZHU Guifu, MENG Shunjian. Study on SQL Injection Detection Based on FlexUDA Model [J]. Computer Science, 2023, 50(6A): 220600172-6.
[5] SU Qi, WANG Hongling, WANG Zhongqing. Unsupervised Script Summarization Based on Pre-trained Model [J]. Computer Science, 2023, 50(2): 310-316.
[6] WANG Bin, LIANG Yudong, LIU Zhe, ZHANG Chao, LI Deyu. Study on Unsupervised Image Dehazing and Low-light Image Enhancement Algorithms Based on Luminance Adjustment [J]. Computer Science, 2023, 50(1): 123-130.
[7] SONG Jie, LIANG Mei-yu, XUE Zhe, DU Jun-ping, KOU Fei-fei. Scientific Paper Heterogeneous Graph Node Representation Learning Method Based onUnsupervised Clustering Level [J]. Computer Science, 2022, 49(9): 64-69.
[8] LI Bin, WAN Yuan. Unsupervised Multi-view Feature Selection Based on Similarity Matrix Learning and Matrix Alignment [J]. Computer Science, 2022, 49(8): 86-96.
[9] CHEN Kun-feng, PAN Zhi-song, WANG Jia-bao, SHI Lei, ZHANG Jin. Moderate Clothes-Changing Person Re-identification Based on Bionics of Binocular Summation [J]. Computer Science, 2022, 49(8): 165-171.
[10] MENG Yue-bo, MU Si-rong, LIU Guang-hui, XU Sheng-jun, HAN Jiu-qiang. Person Re-identification Method Based on GoogLeNet-GMP Based on Vector Attention Mechanism [J]. Computer Science, 2022, 49(7): 142-147.
[11] YANG Xiao-yu, YIN Kang-ning, HOU Shao-qi, DU Wen-yi, YIN Guang-qiang. Person Re-identification Based on Feature Location and Fusion [J]. Computer Science, 2022, 49(3): 170-178.
[12] ZHANG Yu-xin, CHEN Yi-qiang. Driver Distraction Detection Based on Multi-scale Feature Fusion Network [J]. Computer Science, 2022, 49(11): 170-178.
[13] ZHANG Min, YU Zeng, HAN Yun-xing, LI Tian-rui. Overview of Person Re-identification for Complex Scenes [J]. Computer Science, 2022, 49(10): 138-150.
[14] NING Qiu-yi, SHI Xiao-jing, DUAN Xiang-yu, ZHANG Min. Unsupervised Domain Adaptation Based on Style Aware [J]. Computer Science, 2022, 49(1): 271-278.
[15] HOU Hong-xu, SUN Shuo, WU Nier. Survey of Mongolian-Chinese Neural Machine Translation [J]. Computer Science, 2022, 49(1): 31-40.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!