Computer Science ›› 2026, Vol. 53 ›› Issue (5): 257-267.doi: 10.11896/jsjkx.260300053

• Artificial Intelligence • Previous Articles     Next Articles

Robust Incremental Fuzzy Concept-cognitive Emotion Recognition Method Based on Three-wayDecision

XU Weihua, HU Kaiping   

  1. College of Artificial Intelligence, Southwest University, Chongqing 400715, China
  • Received:2026-02-12 Revised:2026-04-04 Published:2026-05-08
  • About author:XU Weihua,born in 1979,Ph.D,professor,Ph.D supervisor.His main research interests include granular computing,cognitive computing,data mining and machine learning.
  • Supported by:
    National Natural Science Foundation of China(62376229,12371465) and Natural Science Foundation of Chongqing(CSTB2023NSCQ-LZX0027,CSTB2023NSCQ-MSX1063).

Abstract: Speech emotion recognition(SER) plays an important role in human-computer interaction systems.In order to solve the problems that the decision making process of existing deep learning models is opaque in the SER task,and the traditional concept-cognitive learning(CCL) is susceptible to noise interference and concept drift when processing incremental data,a three-way weighted fuzzy concept-cognitive classification framework that leverages extremely randomized trees(3WERT-WFCCL) is proposed.In the feature processing,Whisper is used to extract high dimensional speech features,and a multi-layer perceptron(MLP) is used for hierarchical abstract representation.In the cognitive learning stage,the extremely randomized trees(ERT) algorithm is introduced to calculate the importance of features to realize the automated quantitative allocation of attribute weights,and the three-way decision fault tolerance threshold parameter is embedded in the cognitive operator to construct a positive and negative two-way cognitive mechanism.In the face of incremental data,the model divides the new samples into a positive region,a boundary region and a negative region according to the feature identification distance,and adopts a robust strategy that only uses the positive region samples to update the concept,which effectively resists the noise interference.On the SAVEE dataset with more complex feature boundaries,the robust update strategy improves the accuracy by 0.16 percentage points compared with the global update strategy.Experiments on two public datasets EmoDB and SAVEE show that 3WERT-WFCCL is superior to the existing baseline methods in multiple key evaluation indicators.Compared with the baseline models Logistic Regression(LR) with the best performance on each data set,the accuracy of the proposed algorithm is increased by 1.53 percentage points and 0.62 percentage points respectively,and the F1 score is increased by 1.28 percentage points and 0.40 percentage points respectively.Experimental results verify the effectiveness of the three-way decision mechanism,which provides a new method for constructing SER models with high classification accuracy,strong noise robustness and logical interpretability.

Key words: Concept-cognitive learning, Three-way decision, Speech emotion recognition, Granular computing, Formal concept analysis

CLC Number: 

  • TP183
[1]SCHULLER B.Speech emotion recognition:two decades in a nutshell,benchmarks,and ongoing trends[J].Communications of the ACM,2018,61(5):90-99.
[2]HOOK J,NOROOZI F,TOYGAR O,et al.Automaticspeechbased emotion recognition using paralinguistics features[J].Bulletin of the Polish Academy of Sciences:Technical Sciences,2019,67(3):479-488.
[3]INGALE A,CHAUDHARI D.Speech emotion recognition[J].International Journal of Soft Computing and Engineering,2012,2(1):235-238.
[4]EYBEN F,SCHERER K R,SCHULLER B W,et al.The Gene-va minimalistic acoustic parameter set(GeMAPS) for voice research and affective computing[J].IEEE Transactions on Affective Computing,2016,7(2):190-202.
[5]RADFORD A,KIM J W,XU T,et al.Robust speech recognitionvia large-scale weak supervision[C]//International Conference on Machine Learning.PMLR,2023:28492-28518.
[6]PEPINO L,RIERA P,FERRER L.Emotion recognition fromspeech using wav2vec 2.0 embeddings[C]//Interspeech.2021:3400-3404.
[7]MA W,RIVERA H,VALERI J,et al.emotion2vec:Self-supervised pre-training for speech emotion representation[J].arXiv:2312.15185,2023.
[8]LIU Z T,XU J P,WU M,et al.Review of emotional feature extraction and dimension reduction for speech emotion recognition[J].Chinese Journal of Computers,2018,41(12):2833-2851.
[9]JOY J,KANNAN A,RAM S,et al.Speech emotion recognition using neural network and MLP classifier[J].International Journal of Engineering Science and Computing,2020,10(4):25170-25173.
[10]KAUR J,KUMAR A.Speech emotion recognition using CNN,k-NN,MLP and random forest[C]//Computer Networks and Inventive Communication Technologies:Proceedings of Third ICCNCT 2020.Singapore:Springer,2021:499-509.
[11]CHEN L,MAO X,XUE Y,et al.Speech emotion recognition:features and classification models[J].Digital Signal Processing,2012,22(6):1154-1160.
[12]ISSA D,DEMIRCI M,YAZICI A.Speech emotion recognition with deep convolutional neural networks[J].Biomedical Signal Processing and Control,2020,59:101894.
[13]AHMED M,ISLAM S,ISLAM A,et al.An ensemble 1D-CNN-LSTM-GRU model with data augmentation for speech emotion recognition[J].Expert Systems with Applications,2023,218:119633.
[14]GUO D,XU W,DING W,et al.Concept-cognitive learning survey:mining and fusing knowledge from data[J].Information Fusion,2024,109:102426.
[15]SHI Y,MI Y,LI J,et al.Concept-cognitive learning model for incremental concept learning[J].IEEE Transactions on Systems,Man,and Cybernetics:Systems,2018,51(2):809-821.
[16]MI Y,LIU W,SHI Y,et al.Semi-supervised concept learning by concept-cognitive learning and concept space[J].IEEE Transactions on Knowledge and Data Engineering,2020,34(5):2429-2442.
[17]XU W,GUO D,QIAN Y,et al.Two-way concept-cognitivelearning method:a fuzzy-based progressive learning[J].IEEE Transactions on Fuzzy Systems,2022,31(6):1885-1899.
[18]ZHANG T,RONG M,SHAN H,et al.Stability analysis of incremental concept tree for concept cognitive learning[J].International Journal of Machine Learning and Cybernetics,2022,13(1):11-28.
[19]DENG X,LI J,QIAN Y,et al.An emerging incremental fuzzy concept-cognitive learning model based on granular computing and conceptual knowledge clustering[J].IEEE Transactions on Emerging Topics in Computational Intelligence,2024,8(3):2417-2432.
[20]XIN X W,YU H Y,XUE Z,et al.A novel fuzzy concept-cognitive learning model with attribute fluctuation and concept clustering[J].IEEE Transactions on Fuzzy Systems,2025,33(10):3570-3581.
[21]QI J,WEI L,REN R.3-way concept analysis based on 3-valued formal contexts[J].Cognitive Computation,2022,14(1):1900-1912.
[22]LI J,HUANG C,QI J,et al.Three-way cognitive concept lear-ning via multi-granularity[J].Information Sciences,2017,378:244-263.
[23]YUAN K,XU W,LI W,et al.An incremental learning mechanism for object classification based on progressive fuzzy three-way concept[J].Information Sciences,2022,584(1):127-147.
[24]XU W H,JIANG D.A novel concept-cognitive learning model oriented to three-way concept for knowledge acquisition[J].IEEE Transactions on Big Data,2025,11(5):2779-2791.
[25]GUO D,XU W.Fuzzy-based concept-cognitive learning:an in-vestigation of novel approach to tumor diagnosis analysis[J].Information Sciences,2023,639:118998.
[26]GUO D,XU W,QIAN Y,et al.M-FCCL:memory-based concept-cognitive learning for dynamic fuzzy data classification and knowledge fusion[J].Information Fusion,2023,100:101962.
[27]GUO D,XU W,QIAN Y,et al.Fuzzy-granular concept-cogni-tive learning via three-way decision:performance evaluation on dynamic knowledge discovery[J].IEEE Transactions on Fuzzy Systems,2024,32(1):1409-1423.
[28]BURKHARDT F,PAESCHKE A,ROLFES M,et al.A database of German emotional speech[C]//InterSpeech.2005:1517-1520.
[29]HAQ S,JACKSON P J B.Multimodal emotion recognition[C]//Machine Audition:Principles,Algorithms and Systems.IGI Global,2010:398-423.
[1] GU Bokai, LIU Dun, SUN Yang. STWD-DLFRD:Multi-granularity Fake Review Detection via Sequential Three-way Decisions and Deep Learning [J]. Computer Science, 2026, 53(4): 188-196.
[2] QIN Haiqi, MI Jusheng. Concept-cognitive Learning and Incremental Learning in Complex Networks [J]. Computer Science, 2026, 53(4): 208-214.
[3] YAO Jia, LI Dongdong, WANG Zhe. Multi-task Speech Emotion Recognition Incorporating Gender Information [J]. Computer Science, 2026, 53(1): 180-186.
[4] HU Xin, DUAN Jiangli, HUANG Denan. Concept Cognition for Knowledge Graphs by Mining Double Granularity Concept Characteristics [J]. Computer Science, 2025, 52(6A): 240800047-6.
[5] HOU Hanzhong, ZHANG Chao, LI Deyu. Game-theoretic Rough Group Consensus Decision-making Model Based on Individual-Whole SpanAdjustments and Its Applications [J]. Computer Science, 2025, 52(2): 158-164.
[6] WU Shaohua, CHEN Yuming. Granular Perception Machine Based on GRAM Matrix [J]. Computer Science, 2025, 52(11A): 241200110-7.
[7] ZHOU Shilin, WU Weizhi, LI Tongjun. Optimal Scale Combinations and Attribute Reduction for Partially Incomplete Generalized Multi- scale Data [J]. Computer Science, 2025, 52(11): 49-61.
[8] BI Sheng, ZHAI Yanhui, LI Deyu. Decision Implication Preserving Attribute Reduction in Decision Context [J]. Computer Science, 2024, 51(7): 89-95.
[9] ZHANG Jiahao, ZHANG Zhaohui, YAN Qi, WANG Pengwei. Speech Emotion Recognition Based on Voice Rhythm Differences [J]. Computer Science, 2024, 51(4): 262-269.
[10] XUE Renxuan, YI Shichao, WANG Pingxin. GBDEN:A Fast Clustering Algorithm for Large-scale Data Based on Granular Ball [J]. Computer Science, 2024, 51(12): 166-173.
[11] SONG Shuxuan, ZHANG Yuhong, WAN Renxia, MIAO Duoqian. Attribute Reduction of Discernibility Matrix Based on Three-way Decision [J]. Computer Science, 2024, 51(11A): 231100176-6.
[12] CUI Lin, CUI Chenlu, LIU Zhengwei, XUE Kai. Speech Emotion Recognition Based on Improved MFCC and Parallel Hybrid Model [J]. Computer Science, 2023, 50(6A): 220800211-7.
[13] XU Yi, LUO Fan, WANG Min. Three-way Decision Movement Strategy Based on Hierarchical Clustering [J]. Computer Science, 2023, 50(6): 92-99.
[14] YANG Ye, WU Weizhi, ZHANG Jiaru. Optimal Scale Selection and Rule Acquisition in Inconsistent Generalized Decision Multi-scale Ordered Information Systems [J]. Computer Science, 2023, 50(6): 131-141.
[15] XU Fang, MIAO Duoqian, ZHANG Hongyun. Transformer Object Detection Algorithm Based on Multi-granularity [J]. Computer Science, 2023, 50(11): 143-150.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!