Computer Science ›› 2021, Vol. 48 ›› Issue (1): 233-240.doi: 10.11896/jsjkx.200800211

• Artificial Intelligence • Previous Articles     Next Articles

Multi-view Dictionary-pair Learning Based on Block-diagonal Representation

ZHANG Fan1,2,3, HE Wen-qi1,3, JI Hong-bing3, LI Dan-ping4, WANG Lei1,2,3   

  1. 1 Xidian University Qingdao Institute of Computing Technology,Qingdao,Shandong 266000,China
    2 Key Laboratory of Marine Intelligent Equipment and System of Ministry of Education,Shanghai Jiao Tong University,Shanghai 200240,China
    3 School of Electronic Engineering,Xidian University,Xi'an 710071,China
    4 School of Telecommunications Engineering,Xidian University,Xi'an 710071,China
  • Received:2020-08-31 Revised:2020-10-05 Online:2021-01-15 Published:2021-01-15
  • About author:ZHANG Fan,born in 1995,Ph.D student,is a member of China Compu-ter Federation.His main research interests include dictionary learning and multi-view learning.
    WANG Lei,born in 1979,associate professor,is a member of China Computer Federation.His main research interests include pattern recognition,signal & information processing,machine learning and computer vision.
  • Supported by:
    National Key Research and Development Program of China(2016YFE0207000),National Natural Science Foundation of China (61203137,61401328) and Natural Science Basic Research Program of Shaanxi Province of China(2014JQ8306, 2015JM6279).

Abstract: Dictionary learning is widely used in multi-view classification as an efficient feature learning technology.Most multi-view dictionary learning methods either only use part of the information of multi-view data,or only learn one type of dictionary in their frameworks.However,in practice,both the diversity information of multi-view data and the correlation of multi-view data are equally important.A single synthetic dictionary learning scheme or a single analytic dictionary learning scheme cannot meet the requirements of the processing speed,interpretability and application feasibility at the same time.To solve these issues,a novel block-diagonal representation based multi-view dictionary-pair learning framework (BDR-MVDPL) is proposed in this paper.This algorithm obtains the representation coefficients that contain more useful information for classification by introducing dictionary-pair learning model.Firstly,in order to ensure the discriminant ability of the coding coefficient matrix,the proposed me-thod directly enforces a block-diagonal constraint on the coding coefficients with explicit formulation.Then,it adopts a feature fusion strategy to concatenate the coding coefficients of different views,and regresses the concatenated coding coefficients to thecorresponding label vectors.In this way,both the diversity information of multi-view data and the correlation of multi-view data are considered.Finally,it integrates dictionary learning and classifier learning into a unified framework,so that the dictionary-pair and classifier can update alternately in an iterative manner and the whole classification task can be realized automatically.Experiments on several multi-feature datasets show that,compared to other multi-view dictionary learning algorithms,the proposed method achieves competitive performance in terms of classification accuracy,while enjoying a low computational complexity.

Key words: Dictionary learning, Dictionary-pair learning, Multi-view learning, Feature fusion

CLC Number: 

  • TP391
[1] DONG X,ZHU L,SONG X,et al.Adaptive CollaborativeSimilarity Learning for Unsupervised Multi-view Feature Selection[C]//The International Joint Conference on Artificial Intelligence.2018:2064-2070.
[2] LIU D,QIN R,CHEN X,et al.Generation of Three-dimention Vehicle Panorama[J].Computer Science,2017,44(4):302-305.
[3] WANG J H,YAN D Q,LIU D S H,et al.Algorithm with Discriminative Analysis Dictionary Learning by Fusing Extreme Learning Machine[J].Computer Science,2020,47(5):137-143.
[4] LI Y,GUO Y Q,GUO J,et al.CRF with locality-consistent dictionary learning for semantic segmentation[C]//2015 3rd IAPR Asian Conference on Pattern Recognition (ACPR).Kuala Lumpur,2015:509-513.
[5] AHARON M,ELAD M,BRUCKSTEIN A.K-SVD:An algo-rithm for designing overcomplete dictionaries for sparse representation[J].IEEE Transactions on Signal Processing,2006,54(11):4311-4322.
[6] ZHANG Q,LI B X.Discriminative K-SVD for dictionary lear-ning in face recognition[C]//2010 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR).San Francisco,CA.IEEE,2010:2691-2698.
[7] JIANG Z L,LIN Z,DAVIS L S.Label Consistent K-SVD:Learning a Discriminative Dictionary for Recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2013,35(11):2651-2664.
[8] DONG J,WANG W W,DAI W.Analysis SimCO:A new algorithm for analysis dictionary learning[C]//2014 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP),Florence.IEEE,2014:7193-7197.
[9] SHEKHAR S,PATEL V M,CHELLAPPA R.Analysis sparse coding models for image-based classification[C]//2014 IEEE International Conference on Image Processing (ICIP),Paris.IEEE,2014:5207-5211.
[10] GU S H,ZHANG L,ZUO W M,et al.Projective dictionary pair learning for pattern classification[C]//Proc.Conf.Neural Information Processing Systems.Montreal,QC,Canada,2014.
[11] SHI Y,GAO Y,YANG Y,et al.Multimodal Sparse Representa-tion-Based Classification for Lung Needle Biopsy Images[J].IEEE Transactions on Biomedical Engineering,2013,60(10):2675-2685.
[12] JING X Y,HU R M,WU F,et al.Uncorrelated multi-view discrimination dictionary learning for recognition[C]//Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence (AAAI).2014:2787-2795.
[13] JIA Y,SALZMANN M,DARRELL T.Factorized latent spaces with structured sparsity[C]//Advances in neural information processing systems (NIPS).2010:982-990.
[14] ZHENG J J,JIANG Z L,et al.Cross-View Action Recognition via Transferable Dictionary Learning[J].IEEE Transactions on Image Processing,2016,25(6):2542-2556.
[15] ZHUANG Y,WANG Y,WU F,et al.Supervised coupled dictionary learning with group structures for multi-modal retrieval[C]//AAAI Conference on Artificial Intelligence (AAAI).2013:1070-1076.
[16] ZHENG J,JIANG Z.Learning View-Invariant Sparse Representations for Cross-View Action Recognition[C]// IEEE International Conference on Computer Vision.IEEE,2013:3176-3183.
[17] ZHANG H C,NASRABADI N M,ZHANG Y N,et al.Multi-observation visual recognition via joint dynamic sparse representation[C]//2011 International Conference on Computer Vision(ICCV).Barcelona:IEEE,2011:595-602.
[18] JING X Y,HU R M,WU F,et al.Uncorrelated multi-view discrimination dictionary learning for recognition[C]//Proceedings of the Twenty-Eighth AAAI Conference on Artificial Intelligence (AAAI).2014:2787-2795.
[19] GU S,ZHANG L,ZUO W,et al.Projective dictionary pairlearning for pattern classification[C]//Neural Information Processing Systems.2014:793-801.
[20] CHEN B,LI J,MA B,et al.Discriminative dictionary pair lear-ning based on differentiable support vector function for visual reco-gnition[J].Neurocomputing,2017,272(10):306-313.
[21] SUN Y,ZHANG Z,JIANG W,et al.Robust Discriminative Projective Dictionary Pair Learning by Adaptive Representations[C]//International Conference on Pattern Recognition.2018:621-626.
[22] ZHU X,JING X,WU F,et al.Multi-Kernel Low-Rank Dictionary Pair Learning for Multiple Features Based Image Classification[C]//National Conference on Artificial Intelligence.2017:2970-2976.
[23] WANG Q Y,GUO Y Q,WANG J J,et al.Multi-View Analysis Dictionary Learning for Image Classification[J].IEEE Access,2018,6:20174-20183.
[24] LI Z M,LAI Z H,XU Y,et al.A Locality-Constrained and Label Embedding Dictionary Learning Algorithm for Image Classification[J].IEEE Transactions on Neural Networks and Lear-ning Systems,2017,28(2):278-293.
[25] LI Z M,ZHANG Z,QIN J,et al.Discriminative Fisher Embedding Dictionary Learning Algorithm for Object Recognition[J].IEEE Transactions on Neural Networks and Learning Systems,2020,31(3):786-800.
[26] SHEKHAR S,PATEL V M,NASRABADI N M,et al.JointSparse Representation for Robust Multimodal Biometrics Recognition[J].IEEE Transactions on Pattern Analysis and Machine Intelligence,2014,36(1):113-126.
[27] BAHRAMPOUR S,NASRABADI N M,RAY A,et al.Multimodal Task-Driven Dictionary Learning for Image Classification[J].IEEE Transactions on Image Processing,2016,25(1):24-38.
[28] HAGHIGHAT M,ABDEL-MOTTALEB M,ALHALABI W.Discriminant Correlation Analysis:Real-Time Feature Level Fusion for Multimodal Biometric Recognition[J].IEEE Transactions on Information Forensics and Security,2016,11(9):1984-1996.
[29] LI Y,NIE F,HUANG H,et al.Large-scale multi-view spectral clustering via bipartite graph[C]//Twenty-ninth Aaai Confe-rence on Artificial Intelligence.AAAI Press,2015.
[30] FEI-FEI L,FERGUS R,PERONA P.Learning generative visual models from few training examples:An incremental bayesian approach tested on 101 object categories[J].Computer Vision and Image Understanding,2007,106(1):59-70.
[31] WANG L,LI M,JI H,et al.When collaborative representation meets subspace projection:A novel supervised framework of graph construction augmented by anti-collaborative representation[J].Neurocomputing,2019,328:157-170.
[1] ZHONG Ying-yu, CHEN Song-can. High-order Multi-view Outlier Detection [J]. Computer Science, 2020, 47(9): 99-104.
[2] TIAN Xu, CHANG Kan, HUANG Sheng, QIN Tuan-fa. Single Image Super-resolution Algorithm Using Residual Dictionary and Collaborative Representation [J]. Computer Science, 2020, 47(9): 135-141.
[3] HUANG Yong-tao, YAN Hua. Scene Graph Generation Model Combining Attention Mechanism and Feature Fusion [J]. Computer Science, 2020, 47(6): 133-137.
[4] ZHU Wei, WANG Tu-qiang, CHEN Yue-feng, HE De-feng. Object-level Edge Detection Algorithm Based on Multi-scale Residual Network [J]. Computer Science, 2020, 47(6): 144-150.
[5] PEI Jia-zhen, XU Zeng-chun, HU Ping. Person Re -identification Fusing Viewpoint Mechanism and Pose Estimation [J]. Computer Science, 2020, 47(6): 164-169.
[6] HU Yu-jia, GAN Wei, ZHU Min. Enhancer-Promoter Interaction Prediction Based on Multi-feature Fusion [J]. Computer Science, 2020, 47(5): 64-71.
[7] WANG Jun-hao, YAN De-qin, LIU De-shan, XING Yu-jia. Algorithm with Discriminative Analysis Dictionary Learning by Fusing Extreme Learning Machine [J]. Computer Science, 2020, 47(5): 137-143.
[8] CHEN Yan-wen,LI Kun,HAN Yan,WANG Yan-ping. Musical Note Recognition of Musical Instruments Based on MFCC and Constant Q Transform [J]. Computer Science, 2020, 47(3): 149-155.
[9] FU Xue-yang,SUN Qi,HUANG Yue,DING Xing-hao. Single Image De-raining Method Based on Deep Adjacently Connected Networks [J]. Computer Science, 2020, 47(2): 106-111.
[10] ZHOU Peng-cheng,GONG Sheng-rong,ZHONG Shan,BAO Zong-ming,DAI Xing-hua. Image Semantic Segmentation Based on Deep Feature Fusion [J]. Computer Science, 2020, 47(2): 126-134.
[11] GENG Lei-lei, CUI Chao-ran, SHI Cheng, SHEN Zhen, YIN Yi-long, FENG Shi-hong. Social Image Tag and Group Joint Recommendation Based on Deep Multi-task Learning [J]. Computer Science, 2020, 47(12): 177-182.
[12] DUAN Jian-yong, YOU Shi-xin, ZHANG Mei, WANG Hao. Keyword Extraction Based on Multi-feature Fusion [J]. Computer Science, 2020, 47(11A): 73-77.
[13] QIAN Ling-long, WU Jiao, WANG Ren-feng, LU Hui-juan. Multi-document Automatic Summarization Based on Sparse Representation [J]. Computer Science, 2020, 47(11A): 97-105.
[14] MA Kang, LOU Jing-tao, SU Zhi-yuan, LI Yong-le, ZHU Yuan. Object Tracking Algorithm Based on Feature Fusion and Adaptive Scale Kernel Correlation Filter [J]. Computer Science, 2020, 47(11A): 224-230.
[15] LI Hao-xiang, LI Hao-jun. MACTEN:Novel Large Scale Cloth Texture Classification Architecture [J]. Computer Science, 2020, 47(11A): 258-265.
Full text



[1] SUN Qi, JIN Yan, HE Kun and XU Ling-xuan. Hybrid Evolutionary Algorithm for Solving Mixed Capacitated General Routing Problem[J]. Computer Science, 2018, 45(4): 76 -82 .
[2] ZHANG Jia-nan and XIAO Ming-yu. Approximation Algorithm for Weighted Mixed Domination Problem[J]. Computer Science, 2018, 45(4): 83 -88 .
[3] LIU Bo-yi, TANG Xiang-yan and CHENG Jie-ren. Recognition Method for Corn Borer Based on Templates Matching in Muliple Growth Periods[J]. Computer Science, 2018, 45(4): 106 -111 .
[4] PANG Bo, JIN Qian-kun, HENIGULI·Wu Mai Er and QI Xing-bin. Routing Scheme Based on Network Slicing and ILP Model in SDN[J]. Computer Science, 2018, 45(4): 143 -147 .
[5] LUO Xiao-yang, HUO Hong-tao, WANG Meng-si and CHEN Ya-fei. Passive Image-splicing Detection Based on Multi-residual Markov Model[J]. Computer Science, 2018, 45(4): 173 -177 .
[6] FENG Yan-hong, YU Hong, SUN Geng, PENG Song. Diversity Measures Method in High-dimensional Semantic Vector Based on Asymmetric Multi-valued Feature Jaccard Coefficient[J]. Computer Science, 2018, 45(6): 57 -66 .
[7] YIN Qiu-shi, CHEN Jian-hua. Improved Identity Authentication Protocol Based on Elliptic Curve Cryptographyin Multi-server Environment[J]. Computer Science, 2018, 45(6): 111 -116 .
[8] LIU Jing-wei, LIU Jing-ju, LU Yu-liang, YANG Bin, ZHU Kai-long. Optimal Defense Strategy Selection Method Based on Network Attack-Defense Game Model[J]. Computer Science, 2018, 45(6): 117 -123 .
[9] YAO Han-bing, XING Na-na, ZHOU Jun-wei and LI Yong-hua. Study on Secure Retrieval Scheme over Encrypted Data Supporting Result Ranking[J]. Computer Science, 2018, 45(5): 123 -130 .
[10] HE Si-yuan, OU Bo, LIAO Xin. Role Matching Access Control Model for Distributed Workflow[J]. Computer Science, 2018, 45(7): 129 -134 .