Computer Science ›› 2024, Vol. 51 ›› Issue (12): 259-268.doi: 10.11896/jsjkx.240300047

• Artificial Intelligence • Previous Articles     Next Articles

Feature-weighted Counterfactual Explanation Method:A Case Study in Credit Risk Control Scenarios

WANG Baocai, WU Guowei   

  1. School of Software Technology, Dalian University of Technology, Dalian, Liaoning 116000, China
  • Received:2024-03-07 Revised:2024-06-16 Online:2024-12-15 Published:2024-12-10
  • About author:WANG Baocai,born in 1988, Ph.D cadidate.His main research interests include machine learning interpretability and intelligent credit risk control systems.
    WU Guowei,born in 1973,Ph.D,professor,Ph.D supervisor.His main research interests include advanced computing and intelligent systems.

Abstract: The application of machine learning technology in the financial field is becoming more and more prevalent,and providing interpretable machine learning methods to users has become an important research topic.In recent years,counterfactual explanation has attracted widespread attention,which improves the interpretability of machine learning models by providing perturbation vectors to change the predicted results obtained by classifiers.However,existing methods face feasibility and operability issues in generating counterfactual instances.This paper proposes a new counterfactual explanation framework that introduces the concept of feature-variable cost weight matrix,considering the ease of changing different feature variables to make the counterfactual results more realistic and feasible.At the same time,by predefining the feature-variable cost weight matrix by experts,a feasible method for calculating the cost weight of feature variables is proposed,allowing users to make personalized adjustments according to actual situations.The defined objective function comprehensively considers three indicators:feature-weighted distance,sparsity,and proximity,ensuring the feasibility,simplicity,and closeness to the original sample set of counterfactual results.Genetic algorithms are used to solve the problem and generate the optimal action plan.Through experiments on real datasets,it is confirmed that our method can generate feasible and actionable counterfactual instances compared to existing counterfactual me-thods.

Key words: Machine learning, Interpretability, Counterfactual explanation, Weight matrix, Genetic algorithm

CLC Number: 

  • TP391
[1]ALA’RAJ M,ABBOD M.Classifiers consensus system ap-proach for credit scoring[J].Knowledge-Based Systems,2016,104:89-105.
[2]ZHANG M Y.Research on Credit Risk Management in Banking Under the New Situation[J].Chinese Journal of Business Ma-nagement,2016,10(14):15-16.
[3]LEE T S,CHEN I F.A two-stage hybrid credit scoring modelusing artificial neural networks and multivariate adaptive regression splines[J].Expert Systems with Applications,2005,28(4):743-752.
[4]KANG S,CHO S.Approximating support vector machine with artificial neural network for fast prediction[J].Expert Systems with Applications,2014,41(10):4989-4995.
[5]MOHAMMADI N,ZANGENEH M.Customer credit risk as-sessment using artificial neural networks[J].International Journal of Information Technology and Computer Science,2016,8(3):58-66.
[6]LIU X Y,QU Y W,ZHOU Q Y.Self-attention credit assessment model[J].Chinese Journal of Computer Engineering and Applications,2019,55(13):36-41.
[7]YU L,WANG S Y,LAI K K.Credit risk assessment with a multistage neural network ensemble learning approach[J].Expert Systems with Applications,2008,34(2):1434-1444.
[8]ZHOU M X.Study on User Profiling Based on Deep NeuralNetworks[D].Changsha:Hunan University,2018.
[9]MELIS D A,JAAKKOLA T.Towards robust interpretabilitywith self-explaining neural networks[C]//Proceedings of the 32nd Int Conf on Neural Information Processing Systems.USA:Curran Associates Inc.,2018:7775-7784.
[10]POULIN B,EISNER R,SZAFRON D,et al.Visual explanation of evidence with additive classifiers[C]//Proceedings of the 18th Conf on Innovative Applications of Artificial Intelligence.Palo Alto,CA:AAAI Press,2006:1822-1829.
[11]KONONENKO I.An efficient explanation of individual classifications using game theory[J].Journal of Machine Learning Research,2010,11(Jan):1-18.
[12]HAUFE S,MEINECKE F,GÖRGEN K,et al.On the interpretation of weight vectors of linear models in multivariate neuroimaging[J].NeuroImage,2014,87:96-110.
[13]HUYSMANS J,DEJAEGER K,MUES C,et al.An empiricalevaluation of the comprehensibility of decision table,tree and rule based predictive models[J].Decision Support Systems,2011,51(1):141-154.
[14]BRESLOW L A,AHA D W.Simplifying decision trees:A survey[J].The Knowledge Engineering Review,1997,12(1):1-40.
[15]KONG X W,YANG H.A defense method against adversarialexamples based on the interpretability of deep neural network models:China,CN112364885A[P].2021-02-12.
[16]RIBEIRO M T,SINGH S,GUESTRIN C.“Why should I trust you?” Explaining the predictions of any classifier[C]//Procee-dings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.USA:ACM Press,2016:1135-1144.
[17]ZHOU Z H,JIANG Y,CHEN S F.Extracting symbolic rulesfrom trained neural network ensembles[J].AI Communications,2003,16(1):3-15.
[18]LIN K,GAO Y.Model interpretability of financial fraud detection by group SHAP[J].Expert Systems with Applications,2022,210:118354.
[19]RIBEIRO M T,SINGH S,GUESTRIN C.Anchors:High-precision model-agnostic explanations[C]//Proceedings of the 32nd AAAI Conf on Artificial Intelligence.Palo Alto,CA:AAAI Press,2018.
[20]PEARL J.Theoretical impediments to machine learning withseven sparks from the causal revolution[J].arXiv:1801.04016,2018.
[21]RODRIGUEZ P,CACCIA M,LACOSTE A,et al.Beyond Tri-vial Counterfactual Explanations with Diverse Valuable Explanations[C]//Proceedings of the International Conference on Computer Vision(ICCV).2022:1036-1045.
[22]DEL SER J,BARREDO-ARRIETA,DÍAZ-RODRÍGUEZ N,et al.On generating trustworthy counterfactual explanations[J].Information Sciences,2024,655:119898.
[23]POYIADZI R,SOKOL K,SANTOS-RODRIGUEZ,et al.FACE:Feasible and Actionable Counterfactual Explanations[C]//Proceedings of the AAAI/ACM Conference on AI,Ethics,and Society(AIES).New York:ACM,2020.
[24]KANAMORI K,TAKAGI T,KOBAYASHI,et al.DACE:Distribution-aware counterfactual explanation by mixed-integer li-near optimization[C]//Proceedings of the IJCAI International Joint Conference on Artificial Intelligence.2020:2855-2862.
[25]BERK U,ALEXANDER S,YANG L.Actionable recourse inlinear classification[C]//Proceedings of the Conference on Fairness,Accountability,and Transparency.2019:10-19.
[26]CUI Z C,CHEN W L,HE Y J,et al.Optimal action extraction for random forests and boosted trees[C]//Proceedings of the 21th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining.USA:ACM,2015:179-188.
[27]VERMA S,DICKERSON J,HINES K.A Review of Counter-factual Explanations for Machine Learning[J].arXiv:2020:1-13.
[28]BREUNIG M M,KRIEGEL H,NG R T,et al.LOF:Identifying Density-Based Local Outliers[C]//Proceedings of the 2000 ACM SIGMOD International Conference on Management of Data.USA:ACM,2000:4-23.
[29]GUIDOTTI R,MONREALE A,RUGGIERI S,et al.Factualand Counterfactual Explanations for Black Box Decision Making[J].IEEE Intelligent Systems,2019,34(6):14-23.
[30]DANDL S,MOLNAR C,BINDER M,et al.Multi-ObjectiveCounterfactual Explanations[C]//Proceedings of the International Conference on Parallel Problem Solving from Nature.2020:448-469.
[31]WACHTER S,MITTELSTADT B,RUSSELL C.Counterfa-ctual explanations without opening the black box:Automated decisions and the GDPR[J].Harvard Journal of Law & Technology,2018,31(2):842-887.
[1] ZHU Fukun, TENG Zhen, SHAO Wenze, GE Qi, SUN Yubao. Semantic-guided Neural Network Critical Data Routing Path [J]. Computer Science, 2024, 51(9): 155-161.
[2] XIN Bo, DING Zhijun. Interpretable Credit Evaluation Model for Delayed Label Scenarios [J]. Computer Science, 2024, 51(8): 45-55.
[3] LI Haixia, SONG Danlei, KONG Jianing, SONG Yafei, CHANG Haiyan. Evaluation of Hyperparameter Optimization Techniques for Traditional Machine Learning Models [J]. Computer Science, 2024, 51(8): 242-255.
[4] ZHANG Daili, WANG Tinghua, ZHU Xinglin. Overview of Sample Reduction Algorithms for Support Vector Machine [J]. Computer Science, 2024, 51(7): 59-70.
[5] ZHOU Tianyang, YANG Lei. Study on Client Selection Strategy and Dataset Partition in Federated Learning Basedon Edge TB [J]. Computer Science, 2024, 51(6A): 230800046-6.
[6] SI Jia, LIANG Jianfeng, XIE Shuo, DENG Yingjun. Research Progress of Anomaly Detection in IaaS Cloud Operation Driven by Deep Learning [J]. Computer Science, 2024, 51(6A): 230400016-8.
[7] WANG Zhaodan, ZOU Weiqin, LIU Wenjie. Buggy File Identification Based on Recommendation Lists [J]. Computer Science, 2024, 51(6A): 230600088-8.
[8] HUANG Fei, LI Yongfu, GAO Yang, XIA Lei, LIAO Qinglong, DAI Jian, XIANG Hong. Scheduling Optimization Method for Household Electricity Consumption Based on Improved Genetic Algorithm [J]. Computer Science, 2024, 51(6A): 230600096-6.
[9] LIU Wei, SONG You, ZHUO Peiyan, WU Weiqiang, LIAN Xin. Study on Kcore-GCN Anti-fraud Algorithm Fusing Multi-source Graph Features [J]. Computer Science, 2024, 51(6A): 230600040-7.
[10] CHEN Xiangxiao, CUI Xin, DU Qin, TANG Haoyao. Study on Optimization of Abnormal Traffic Detection Model Based on Machine Learning [J]. Computer Science, 2024, 51(6A): 230700051-5.
[11] XU Haitao, CHENG Haiyan, TONG Mingwen. Study on Genetic Algorithm of Course Scheduling Based on Deep Reinforcement Learning [J]. Computer Science, 2024, 51(6A): 230600062-8.
[12] TIAN Shuaihua, LI Zheng, WU Yonghao, LIU Yong. Identifying Coincidental Correct Test Cases Based on Machine Learning [J]. Computer Science, 2024, 51(6): 68-77.
[13] LI Zhibo, LI Qingbao, LAN Mingjing. Method of Generating Test Data by Genetic Algorithm Based on ART Optimal Selection Strategy [J]. Computer Science, 2024, 51(6): 95-103.
[14] LIN Binwei, YU Zhiyong, HUANG Fangwan, GUO Xianwei. Data Completion and Prediction of Street Parking Spaces Based on Transformer [J]. Computer Science, 2024, 51(4): 165-173.
[15] WANG Degang, SUN Yi, GAO Qi. Active Membership Inference Attack Method Based on Multiple Redundant Neurons [J]. Computer Science, 2024, 51(4): 373-380.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!