Computer Science ›› 2019, Vol. 46 ›› Issue (12): 89-94.doi: 10.11896/jsjkx.190300095

• Big Data & Data Science • Previous Articles     Next Articles

Domain Adaptation Algorithm Based on Tensor Decomposition

XU Shu-yan, HAN Li-xin, XU Guo-xia   

  1. (College of Computer and Information,Hohai University,Nanjing 211100,China)
  • Received:2019-03-20 Online:2019-12-15 Published:2019-12-17

Abstract: Because training data tend to be outdated,training data and test data have different feature distributions in most cases.Therefore,when using the source domain information,it is necessary to minimize the difference of feature distributions in different fields.Features represented by tensor can maintain the intrinsic structure information of high-dimensional spatial data.Naive tensor subspace learning is a domain adaptation method for tensor features,but it has high complexity and can not achieve good knowledge transfer effect.For this reason,this paper proposed a domain adaptation algorithm based on tensor decomposition,namely tensor train subspace learning and tensor ring subspace lear-ning,and the main ideas of the two methods are similar.Firstly,the features of source domain and target domain are coded into tensor.By using the tensor decomposition,the tensor of features is decomposed into a series of third-order tensors to represent the subspace.Then,the features of source domain and target domain are mapped into subspace successively.Finally,the feature tensor is reshaped into matrix form.Based on the mapped features of source domain training model and the mapped feature of target domain,the task in new domain is completed.Experiments show that the tensor train subspace learning and the tensor ring subspace learning are improved in terms of accuracy and running time for unsupervised image classification.Compared with the naive tensor subspace learning,the accuracy of the tensor train subspace learning and the tensor ring subspace learning is improved by 1.68% and 2.08% respectively,the running time is also reduced significantly,and the complexity of the algorithm is smaller.Experimental results show that the domain adaptation algorithm based on tensor decomposition can reduce the difference between source domain and target domain,and realize the reuse of knowledge between different domains.

Key words: Domain adaptation, Image classification, Subspace learning, Tensor decomposition, Transfer learning

CLC Number: 

  • TP181
[1]PAN S J,YANG Q.A survey on transfer learning[J].IEEE Transactions on knowledge and data engineering,2010,22(10):1345-1359.
[2]LONG M S.Transfer Learning:Problems and Methods[D].Beijing:Tsinghua University,2014.(in Chinese)
龙明盛.迁移学习问题与方法研究[D].北京:清华大学,2014.
[3]ZHANG Z,WANG M,HUANG Y,et al.Aligning infinite-dimensional covariance matrices in reproducing kernel hilbert spaces for domain adaptation[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2018:3437-3445.
[4]YANG B,MA A J,YUEN P C.Domain-Shared Group-Sparse Dictionary Learning for Unsupervised Domain Adaptation[C]//Thirty-Second AAAI Conference on Artificial Intelligence.AAAI,2018.
[5]MENG J,HU G Y,PAN Z S,et al.Research and Perspective on Domain Adaptation Learning Algorithms[J].Computer Science,2015,42(10):7-12,34.(in Chinese)
孟娟,胡谷雨,潘志松,等.领域适应学习算法研究与展望[J].计算机科学,2015,42(10):7-12,34.
[6]LIU J W,SUN Z K,LUO X L.Review and Research Development on Domain Adaptation Learning[J].Acta Automatica Sinica,2014,40(8):1576-1600.(in Chinese)
刘建伟,孙正康,罗雄麟.域自适应学习研究进展[J].自动化学报,2014,40(8):1576-1600.
[7]LU H,ZHANG L,CAO Z,et al.When unsupervised domain adaptation meets tensor representations[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2017:599-608.
[8]TUCKER L R.Some mathematical notes on three-mode factor analysis[J].Psychometrika,1966,31(3):279-311.
[9]KOLDA T G,BADER B W.Tensor decompositions and applications[J].SIAM review,2009,51(3):455-500.
[10]ORÚ S R.A practical introduction to tensor networks:Matrix product states and projected entangled pair states[J].Annals of Physics,2014,349:117-158.
[11]MURG V,VERSTRAETE F,SCHNEIDER R,et al.Tree tensor network state with variable tensor order:An efficient multireference method for strongly correlated systems[J].Journal of chemical theory and computation,2015,11(3):1027-1036.
[12]OSELEDETS I V.Tensor-train decompositi-on[J].SIAM Journal on Scientific Computing,2011,33(5):2295-2317.
[13]HÜBENER R,NEBENDAHL V,DÚ R W.Concatenated tensor network states[J].New Journal of Physics,2010,12(2):025004.
[14]BENGUA J A,HO P N,TUAN H D,et al.Matrix product state for higher-order tensor compression and classification[J].IEEE Transactions on Signal Processing,2017,65(15):4019-4030.
[15]ZHAO Q,ZHOU G,XIE S,et al.Tensor ring decomposition [J].arXiv:1606.05535,2016.
[16]MICKELIN O,KARAMAN S.Tensor ring decomposition[J].arXiv:1807.02513,2018.
[17]WANG W,AGGARWAL V,AERON S.Efficient low rank tensor ring completion[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2017:5697-5705.
[18]FERNANDO B,HABRARD A,SEBBAN M,et al.Unsuper- vised visual domain adaptation using subspace alignment[C]//Proceedings of the IEEE International Conference on Computer Vision.IEEE,2013:2960-2967.
[19]GONG B,SHI Y,SHA F,et al.Geodesic flow kernel for unsupervised domain adaptationn[C]//2012 IEEE Conference on Computer Vision and Pattern Recognition.IEEE,2012:2066-2073.
[20]LONG M,WANG J,DING G,et al.Transfer learning with graph co-regularization[J].IEEE Transactions on Knowledge and Data Engineering,2014,26(7):1805-1818.
[21]SAENKO K,KULIS B,FRITZ M,et al.Adapting visual category models to new domains[C]//European Conference on Computer Vision.Berlin:Springer,2010:213-226.
[22]GRIFFIN G,HOLUB A,PERONA P.Caltech-256 object category dataset:Technical Report 7694 [R].California Institute of Technology,2007.
[23]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[24]HE K,ZHANG X,REN S,et al.Spatial pyramid pooling in deep convolutional networks for visual recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2015,37(9):1904-1916.
[1] WU Hong-xin, HAN Meng, CHEN Zhi-qiang, ZHANG Xi-long, LI Mu-hang. Survey of Multi-label Classification Based on Supervised and Semi-supervised Learning [J]. Computer Science, 2022, 49(8): 12-25.
[2] FANG Yi-qiu, ZHANG Zhen-kun, GE Jun-wei. Cross-domain Recommendation Algorithm Based on Self-attention Mechanism and Transfer Learning [J]. Computer Science, 2022, 49(8): 70-77.
[3] WANG Jun-feng, LIU Fan, YANG Sai, LYU Tan-yue, CHEN Zhi-yu, XU Feng. Dam Crack Detection Based on Multi-source Transfer Learning [J]. Computer Science, 2022, 49(6A): 319-324.
[4] YANG Jian-nan, ZHANG Fan. Classification Method for Small Crops Combining Dual Attention Mechanisms and Hierarchical Network Structure [J]. Computer Science, 2022, 49(6A): 353-357.
[5] DU Li-jun, TANG Xi-lu, ZHOU Jiao, CHEN Yu-lan, CHENG Jian. Alzheimer's Disease Classification Method Based on Attention Mechanism and Multi-task Learning [J]. Computer Science, 2022, 49(6A): 60-65.
[6] ZHU Xu-dong, XIONG Yun. Study on Multi-label Image Classification Based on Sample Distribution Loss [J]. Computer Science, 2022, 49(6): 210-216.
[7] ZHANG Wen-xuan, WU Qin. Fine-grained Image Classification Based on Multi-branch Attention-augmentation [J]. Computer Science, 2022, 49(5): 105-112.
[8] PENG Yun-cong, QIN Xiao-lin, ZHANG Li-ge, GU Yong-xiang. Survey on Few-shot Learning Algorithms for Image Classification [J]. Computer Science, 2022, 49(5): 1-9.
[9] TAN Zhen-qiong, JIANG Wen-Jun, YUM Yen-na-cherry, ZHANG Ji, YUM Peter-tak-shing, LI Xiao-hong. Personalized Learning Task Assignment Based on Bipartite Graph [J]. Computer Science, 2022, 49(4): 269-281.
[10] ZUO Jie-ge, LIU Xiao-ming, CAI Bing. Outdoor Image Weather Recognition Based on Image Blocks and Feature Fusion [J]. Computer Science, 2022, 49(3): 197-203.
[11] ZHANG Shu-meng, YU Zeng, LI Tian-rui. Transferable Emotion Analysis Method for Cross-domain Text [J]. Computer Science, 2022, 49(3): 218-224.
[12] XU Hua-jie, CHEN Yu, YANG Yang, QIN Yuan-zhuo. Semi-supervised Learning Method Based on Automated Mixed Sample Data Augmentation Techniques [J]. Computer Science, 2022, 49(3): 288-293.
[13] DONG Lin, HUANG Li-qing, YE Feng, HUANG Tian-qiang, WENG Bin, XU Chao. Survey on Generalization Methods of Face Forgery Detection [J]. Computer Science, 2022, 49(2): 12-30.
[14] NING Qiu-yi, SHI Xiao-jing, DUAN Xiang-yu, ZHANG Min. Unsupervised Domain Adaptation Based on Style Aware [J]. Computer Science, 2022, 49(1): 271-278.
[15] LIU Kai, ZHANG Hong-jun, CHEN Fei-qiong. Name Entity Recognition for Military Based on Domain Adaptive Embedding [J]. Computer Science, 2022, 49(1): 292-297.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!