Computer Science ›› 2020, Vol. 47 ›› Issue (11A): 106-110.doi: 10.11896/jsjkx.200100018

• Artificial Intelligence • Previous Articles     Next Articles

Variable Ordering Selection for Cylindrical Algebraic Decomposition Based on Hierarchical Neural Network

ZHU Zhang-peng1,2, CHEN Chang-bo2   

  1. 1 Chongqing University of Posts and Telecommunications,Chongqing 400065,China
    2 Chongqing Institute of Green and Intelligent Technology,Chinese Academy of Sciences,Chongqing 400714,China
  • Online:2020-11-15 Published:2020-11-17
  • About author:ZHU Zhang-peng,born in 1993,master,is a member of China Computer Federation.His main research interests include machine learning and so on.
    CHEN Chang-bo,born in 1981,Ph.D,associate professor,is a member of China Computer Federation.His main research interests include symbolic-numeric computation,automatic paralle-lization andoptimization of computerprograms and machine learning.
  • Supported by:
    This work was supported by the National Natural Science Foundation of China (11771421,1671377,61572024),Chinese Academy of Sciences “Light of the West”,Chongqing Academician-led Science and Technology Innovation Guidance Project (cstc2018jcyj-yszxX0002).

Abstract: Cylindrical algebraic decomposition (CAD) is a widely used approach for computing the real solutions of polynomial systems.The choice of variable ordering has a significant impact on its computation time.Most of existing ordering selection algorithms are based on heuristic empirical algorithms,whose accuracy are not high.A few approaches based on machine learning use small data sets and are based on complex human characteristics.In this paper,on the basis of randomly generating a large set of polynomial systems,which are tagged with timings obtained by applying different orderings for computing CAD,a new kind of explicit representation feature and a new hierarchical neural network are proposed.Firstly,according to the computation time of CAD with the worst ordering,the data set is divided into four subsets with different computation difficulties,and the classification models are established respectively.Secondly,a regression model for predicting the longest computation time is built.Finally,the longest computation time is predicted according to the regression model,based on which a classification model with right computation difficulty is automatically selected to predict the optimal variable ordering.Experimental results show that the performance of explicit features is better than that of complex handcrafted features,and the performance of the optimal ordering predicted by hierarchical neural network on difficult problems is about two times better than that of an empirical algorithm.

Key words: Cylindrical algebraic decomposition, Feature selection, Hierarchical neural network, Regression, Variable ordering

CLC Number: 

  • TP391
[1] LLIAS S,KOTSIREAS,EDGAR M.Applications of computer algebra[M].Kalamata:Springer International Publishing,2017.
[2] BLUMLEIN J,MAIER A,MARQUARD P,et al.From mo-mentum expansions to post-Minkowskian Hamiltonians by computer algebra algorithms[J].Physics Letters B,2020,801.
[3] JOSE L G G,GABRIEL A V,PEDRO R C,et al.SFOPDES:A Stepwise First Order Partial Differential Equations Solver with a Computer Algebra Syst-em [J].Computers and Mathematics with Applications,2019,78(9):3152-3164.
[4] WANG D M,XIA B C,LI Z M.Computer Alg-ebra[M].Beijing:Tsinghua University Press,2007.
[5] BROWN C W,DAVENPORT J H.The comple-xity of quantifier elimination and cylindrical algebr-aic decomposition[C]//International Symposium on Symbolic and Algebraic Computation.2007:54-60.
[6] GOODFELLOW I,BENGIO Y,COURVILLE A.Deep Learning[M].London:Massachusetts Institute of Technology Press,2016.
[7] MALL S,CHAKRAVERTY S.Single Layer C-hebyshev Neural Network Model for Solving Ellipt-ic Partial Differential Equations[J].Neural Processing Letters,2017,45(3):1-16.
[8] LAMPLE G,CHARTON F.Deep Learning for Symbolic Mathematics [EB/OL].(2019-10-02) [2019-12-23].https://arxiv.org/abs/1912.01412.
[9] CHEN C B,MAZA M M,XIA B C,et al.Com-puting cylindrical algebraic decomposition via trian-gular decomposition[C]//International Symposium on Symbolic and Algebraic Computation.2009:95-102.
[10] HUANG Z Y,ENGLAND M,WILSON D J,et al.Applying machine learning to the problem of choosing a heuristic to select the variable ordering for cylindrical algebraic decomposition[C]//Intelligent Computer Mathematics.2014:92-107.
[11] ENGLAND M,FLORESCU D.Comparing Machine LearningModels to Choose the Variable Ordering for Cylindrical Algebraic Decomposition[C]//Conference on Intelligent Computer Mathematics.2019:93-108.
[12] ZHU Z P,CHEN C B.Variable Order Selection for Cylindrical Algebraic Decomposition Based on Machine Learning [EB/OL].(2019-04-10) [2019-12-23].https://www.researchgate.net/publication/332749898_Variable_Order_Selection_for_Cylindrical_Algebraic_Decomposition_Based_on_Machine_Learning.
[13] COLLINS G E.Quantifier elimination for real closed fields by cylindrical algebraic decomposition[J].Springer Lecture Notes in Computer Science,1975,33:515-532.
[14] ARNON D S,COLLINS G E,MCCALLUM S.Cylindrical algebraic decomposition I:The basic algorithm[C]//SIAM Journal of Computing,1984,13(4):865-877.
[15] MCCALLUM S.An improved projection oper-ation for cylindrical algebraic decomposition[C]//European Conference on Computer Algebra,1985,2:277-278.
[16] COLLINS G E,HU H.Partial cylindrical alg-ebraic decomposition for quantifier elimination [J].Journal of Symbolic Computation,1991,12:299-328.
[17] BROWN C W.Improved projection for cylin-drical algebraic decomposition [J].Journal of Sym-bolic Computation,2001,32(5):447-465.
[18] STRZEBONSKI A W.Cylindrical Algebraic Decompositionusing validated numerics[J].Journal of Symbolic Computation,2006,41(9):1021-1038.
[19] IWANE H,YANAMI H,ANAI H,et al.An ef-fective implementation of a symbolic-numeric cylindrical algebraic decomposition for quantifier elimination[C]//Symbolic Numeric Computation.2009:55-64.
[20] DOLZMANN A,SEIDL A,STURM T.Efficie-nt projecttion orders for CAD[C]//International Symposium on Symbolic and Algebraic Computation.2004:111-118.
[21] CHEN C B,MORENO MAZA M.Quantifier elimina-tion by cylindrical algebraic decomposition based on regular chains [J].Journal of Symbolic Computation,2016,75:74-93.
[22] WANG R B,XU H Y,LI B,et al.Research on Method of Determining Hidden Layer Nodes in BP Neural Network [J].Computer Technology and Development,2018,28(4):31-35.
[1] LYU You, WU Wen-yuan. Privacy-preserving Linear Regression Scheme and Its Application [J]. Computer Science, 2022, 49(9): 318-325.
[2] LI Bin, WAN Yuan. Unsupervised Multi-view Feature Selection Based on Similarity Matrix Learning and Matrix Alignment [J]. Computer Science, 2022, 49(8): 86-96.
[3] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[4] KANG Yan, WANG Hai-ning, TAO Liu, YANG Hai-xiao, YANG Xue-kun, WANG Fei, LI Hao. Hybrid Improved Flower Pollination Algorithm and Gray Wolf Algorithm for Feature Selection [J]. Computer Science, 2022, 49(6A): 125-132.
[5] CHEN Yong-ping, ZHU Jian-qing, XIE Yi, WU Han-xiao, ZENG Huan-qiang. Real-time Helmet Detection Algorithm Based on Circumcircle Radius Difference Loss [J]. Computer Science, 2022, 49(6A): 424-428.
[6] WANG Wen-qiang, JIA Xing-xing, LI Peng. Adaptive Ensemble Ordering Algorithm [J]. Computer Science, 2022, 49(6A): 242-246.
[7] LI Jing-tai, WANG Xiao-dan. XGBoost for Imbalanced Data Based on Cost-sensitive Activation Function [J]. Computer Science, 2022, 49(5): 135-143.
[8] CHU An-qi, DING Zhi-jun. Application of Gray Wolf Optimization Algorithm on Synchronous Processing of Sample Equalization and Feature Selection in Credit Evaluation [J]. Computer Science, 2022, 49(4): 134-139.
[9] SUN Lin, HUANG Miao-miao, XU Jiu-cheng. Weak Label Feature Selection Method Based on Neighborhood Rough Sets and Relief [J]. Computer Science, 2022, 49(4): 152-160.
[10] ZHAO Yue, YU Zhi-bin, LI Yong-chun. Cross-attention Guided Siamese Network Object Tracking Algorithm [J]. Computer Science, 2022, 49(3): 163-169.
[11] LI Zong-ran, CHEN XIU-Hong, LU Yun, SHAO Zheng-yi. Robust Joint Sparse Uncorrelated Regression [J]. Computer Science, 2022, 49(2): 191-197.
[12] LIU Zhen-yu, SONG Xiao-ying. Multivariate Regression Forest for Categorical Attribute Data [J]. Computer Science, 2022, 49(1): 108-114.
[13] CHEN Le, GAO Ling, REN Jie, DANG Xin, WANG Yi-hao, CAO Rui, ZHENG Jie, WANG Hai. Adaptive Bitrate Streaming for Energy-Efficiency Mobile Augmented Reality [J]. Computer Science, 2022, 49(1): 194-203.
[14] CHEN Chang-wei, ZHOU Xiao-feng. Fast Local Collaborative Representation Based Classifier and Its Applications in Face Recognition [J]. Computer Science, 2021, 48(9): 208-215.
[15] ZHANG Ye, LI Zhi-hua, WANG Chang-jie. Kernel Density Estimation-based Lightweight IoT Anomaly Traffic Detection Method [J]. Computer Science, 2021, 48(9): 337-344.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!