Computer Science ›› 2023, Vol. 50 ›› Issue (11A): 220800046-7.doi: 10.11896/jsjkx.220800046

• Big Data & Data Science • Previous Articles     Next Articles

CMIHC Algorithm for Bayesian Network Structure Learning

LI Xiaoqing, YU Haizheng   

  1. College of Mathematics and Systems Science,Xinjiang University,Urumqi 830046,China
  • Published:2023-11-09
  • About author:LI Xiaoqing,born in 1996,postgra-duate.Her main research interests include Bayesian network structure learning and so on.
    YU Haizheng,born in 1976,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include big data analysis and so on.
  • Supported by:
    National Natural Science Foundation of China(61662079,11761070,U1703262) and Xinjiang Natural Science Foundation(2021D01C078).

Abstract: Bayesian network originates from the research on uncertain problems in the field of artificial intelligence.It is an important tool for reasoning and data analysis of uncertain problems.Since the birth of Bayesian network structure learning,there have been many mature structure learning algorithms,including dependency analysis based method,score based search method and hybrid search method.Among them,structure pruning by information theory has become a common method,but there is no unified standard for the selection of condition set in conditional mutual information,resulting in inconsistent pruning of network structure.The hill climbing algorithm uses three search operators to update the network structure locally,and obtains the optimal structure through the scoring function.Combined with the idea of information theory and hill climbing algorithm,a new structure learning algorithm-conditional mutual information hill climbing(CMIHC) algorithm is proposed.The proposed algorithm prunes the initial connected graph by using mutual information and the created condition set,and orients it to obtain the initial network structure.Combined with the scoring function and the greedy search strategy of hill climbing algorithm,the optimal network structure is obtained.Experimental analysis shows that CMIHC algorithm is superior to other comparison algorithms in accuracy and efficiency.

Key words: Bayesian network, Structure learning, Conditional mutual information, Hill climbing algorithm, CMIHC algorithm

CLC Number: 

  • TP181
[1]ZHANG L W,GUO H P.Introduction to Bayesian Networks[M].Beijing:Science Publishing House,2006.
[2]LOU C Y,LI X S,ATOUI M A.Bayesian network based on an adaptive threshold scheme for fault detection and classification[J].Industrial and Engineering Chemistry Research,2020,59(34):15155-15164.
[3]TAGHI-MOLLA A,RABBANI M,KARIMI GAVARESHKIM H,et al.Safety improvement in a gas refinery based on resilience engineering and macro-ergonomics indicators:a Bayesian network-artificial neural network approach[J].Intermational Journal of System Assurance Engineering and Management,2020,11(3):641-654.
[4]WANG H,GUO X D,ZHU H.Research on causal reasoning method of domain ontology based on Bayesian network[J].Application Research of Computers,2019,36(3):711-715.
[5]LU E S,HAN M G,LIU F,et al.Analysis of Chinese medicine syndrome rules of severe pneumonia based on Bayesian network[J].Acta Chinese Medicine,2022,37(1):173-179.
[6]CHENG L X,YAN J N,JIAO Y,et al.Bayesian network methodfor remote sensing cloud user behavior authentication[J].Application Research of Computers,2019,36(2):441-445.
[7]LI S H,ZHANG J.Review of Bayesian networks structurelearning[J].Application Research of Computers,2015,32(3):641-646.
[8]SPIRTES P,GLYMOUR C,SCHEINES R.Causality fromProbability[M].London:Pima,Evolving Knowledge in Natural Science and Artificial Intelligence,1990:181-199.
[9]SPIRTES P,GLYMOUR C.An algorithm for fast recovery of sparse causal graphs[J].Social Science Computer Review,1991,9(1):62-72.
[10]CHENG J,GREINER R,KELLY J,et al.Learning Bayesiannetworks from data:An information-theory based approach[J].Artificial Intelligence,2002,137(1/2):43-90.
[11]XU P F,YANG Z.Accelerating GDS algorithm with L1 penalty for Bayesian network[J].Journal of Changchun University of Technology,2020,41(2):118-121.
[12]XU P F,WANG S D,SHANG L X,et al.Structural learning of Gaussian Bayesian network by bootstrap[J].Journal of Changchun University of Technology,2020,41(4):313-321.
[13]ZHAO J Z,WU C N,WANG X W,et al.Structure Learning Algorithm of Bayesian Networks Based on Markov Blanket[J].Journal of Northeastern University(Natural Science),2020,41(4):464-469,481.
[14]HERSKOVITS E.Computer-based probabilistic-network con-struction[D].Stanford University,1991.
[15]HECKERMAN D,GEIGER D,CHICKERING D M.Learning Bayesian networks:The combination of knowledge and statistical data[J].Machine learning,1995,20(3):197-243.
[16]GUO Z,CONSTANTINOU A C.Approximate learning of high dimensional Bayesian network structures via pruning of candidate parent sets[J].Entropy,2020,22(10):1142.
[17]BEHJATI S,BEIGY H.Improved K2 algorithm for Bayesian network structure learning[J].Engineering Applications of Artificial Intelligence,2020,91:103617.
[18]LV Y,MIAO J,LIANG J,et al.BIC-based node order learning for improving Bayesian network structure learning[J].Frontiers of Computer Science,2021,15(6):1-14.
[19]TSAMARDINOS I,BROWN E L,ALIFERIS C F.The max-min hill-climbing Bayesian network structure learning algorithm[J].Machine Learning,2006,65(1):31-78.
[20]LIU X,GAO X,WANG Z,et al.Improved local search with momentum for Bayesian networks structure learning[J].Entropy,2021,23(6):750.
[21]SUN B,ZHOU Y,WANG J,et al.A new PC-PSO algorithm for Bayesian network structure learning with structure priors[J].Expert Systems With Applications,2021,184:115237.
[22]WANG Y,TAN S Q,LIU Y H.Bayesian network structural learning algorithm based on mutual information[J].Computer Engineering,2011,37(7):62-64.
[23]LI B H,GAO X L,LIU S Y,et al.Learning Bayesian network structures based on mutual information[J].CAAI Transactions on Intelligent Systems,2011,6(1):68-72.
[24]JIN Y,HU Y A,ZHANG J,et al.Bayesian network structurelearning combining mutual information with hill climbing algorithm[J].Computer Applications and Software,2012,29(9):122-125.
[25]WU Y G,PANG S C.K2&HC Structure learning algorithm[J].Computer and Digital Engineering,2014,42(7):1137-1140,1145.
[26]LIU H R,LI X,MA M,et al.Simplified Greedy Algorithm for Bayesian Network Structure Learning[J].Journal of Chinese Computer Systems,2015,36(2):306-309.
[27]LIU B,LIU Y J,LIU H R,et al.A study of fault diagnosis mo-del of rotary kiln based on improved structural algorithm of Bayesian[J].China Mechanical Engineering,2017,28(18):2143-2151.
[28]LONG Y G.Learning Bayesian network structure basing on Information theory and causal effect[D].Changchun:Jilin University,2020
[29]GAO X G,WANG C F,DI R H.A block learning algorithmwith improved K-means algorithm for learning sparse BN optimal structure[J].Acta Automatica Sinica,2020,46(5):923-933.
[30]WU B W.Hybrid uncertainty Bayesian networks learning model and implementation by R[D].Guangzhou:South China University of Technology,2013.
[31]ZHAO J Z,WU C N,WANG X W,et al.Structure learning algorithm of Bayesian networks based on markov blanket[J].Journal of Northeastern University(Natural Science),2020,41(4):464-469,481.
[1] XU Miao, WANG Huiling, LIANG Yi, QI Xiaolong, GAO Yang. Improved K2 Algorithm Based on Two-step Search Strategy [J]. Computer Science, 2023, 50(9): 303-310.
[2] MA Mengyu, SUN Jiaxiang, HU Chunling. Modeling Gene Regulatory Networks with Global Coupling Parameters [J]. Computer Science, 2023, 50(11A): 221100088-7.
[3] LI Mingjia, QIAN Hong, ZHOU Aimin. Hybrid Bayesian Network Structure Learning via Evolutionary Order Search [J]. Computer Science, 2023, 50(10): 230-238.
[4] LI Jia-rui, LING Xiao-bo, LI Chen-xi, LI Zi-mu, YANG Jia-hai, ZHANG Lei, WU Cheng-nan. Dynamic Network Security Analysis Based on Bayesian Attack Graphs [J]. Computer Science, 2022, 49(3): 62-69.
[5] ZHONG Kun-hua, CHEN Yu-wen, QIN Xiao-lin. Sub-BN-Merge Based Bayesian Network Structure Learning Algorithm [J]. Computer Science, 2022, 49(11A): 210800172-7.
[6] LI Chao, QIN Biao. Efficient Computation of Intervention in Causal Bayesian Networks [J]. Computer Science, 2022, 49(1): 279-284.
[7] LI Chao, QIN Biao. Efficient Computation of MPE in Causal Bayesian Networks [J]. Computer Science, 2021, 48(4): 14-19.
[8] XU Yuan-yin,CHAI Yu-mei,WANG Li-ming,LIU Zhen. Emotional Sentence Classification Method Based on OCC Model and Bayesian Network [J]. Computer Science, 2020, 47(3): 222-230.
[9] ZHANG Cheng-wei, LUO Feng-e, DAI Yi. Prediction Method of Flight Delay in Designated Flight Plan Based on Data Mining [J]. Computer Science, 2020, 47(11A): 464-470.
[10] LIN Lang, ZHANG Zi-li. Bayesian Structure Learning Based on Physarum Polycephalum [J]. Computer Science, 2019, 46(9): 206-210.
[11] CHAI Hui-min, FANG Min, LV Shao-nan. Local Path Planning of Mobile Robot Based on Situation Assessment Technology [J]. Computer Science, 2019, 46(4): 210-215.
[12] LIU Hui-qing, GUO Yan-bu, LI Hong-ling, LI Wei-hua. Short Text Feature Extension Method Based on Bayesian Networks [J]. Computer Science, 2019, 46(11A): 66-71.
[13] XING Zhi-wei, ZHU Hui, LI Biao, LUO Qian. Dynamic Estimation of Flight Departure Time Based on Bayesian Network [J]. Computer Science, 2019, 46(10): 329-335.
[14] ZHANG Zhi-dong, WANG Zhi-hai, LIU Hai-yang and SUN Yan-ge. Ensemble Multi-label Classification Algorithm Based on Tree-Bayesian Network [J]. Computer Science, 2018, 45(3): 189-195.
[15] XU Jian-rui, LI Zhan-wu and XU An. KDE-CGA Algorithm of Structure Learning for Small Sample Data Bayesian Network [J]. Computer Science, 2017, 44(Z11): 437-441.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!