Computer Science ›› 2022, Vol. 49 ›› Issue (6A): 125-132.doi: 10.11896/jsjkx.210600135

• Intelligent Computing • Previous Articles     Next Articles

Hybrid Improved Flower Pollination Algorithm and Gray Wolf Algorithm for Feature Selection

KANG Yan, WANG Hai-ning, TAO Liu, YANG Hai-xiao, YANG Xue-kun, WANG Fei, LI Hao   

  1. School of Software,Yunnan University,Kunming 650500,China
  • Online:2022-06-10 Published:2022-06-08
  • About author:KANG Yan,born in 1972,postgraduate supervisor,is a member of China Computer Federation.Her main research interests include machine learning and software engineering.
    LI Hao,born in 1970,postgraduate supervisor,is a member of China ComputerFederation.His main research interests include machine learning and software engineering.
  • Supported by:
    Yunnan Provincial Science and Technology Department Major Special Projects(2019ZE001-1,202002AB080001-6).

Abstract: Feature selection is very important in the stage of data preprocessing.The quality of feature selection not only affects the training time of the neural network but also affects the performance of the neural network.Grey Wolf improved Flower pollination algorithm(Grey Wolf improved Flower pollination algorithm,GIFPA) is a hybrid algorithm based on the fusion of flower pollination algorithm framework and gray wolf optimization algorithm.When it is applied to feature selection,it can not only retain the connotation information of the original features but also maximize the accuracy of classification features.The GIFPA algorithm adds the worst individual information to the FPA algorithm,uses the cross-pollination stage of the FPA algorithm as the global search,uses the hunting process of the gray wolf optimization algorithm as the local search,and adjusts the search process of the two through the conversion coefficient.At the same time,to overcome the problem that swarms intelligence algorithm is easy to fall into local optimization,this paper uses the RelifF algorithm in the field of data mining to improve this problem and uses the RelifF algorithm to filter out high weight features and improve the best individual information.To verify the performance of the algorithm,21 classical data sets in the UCI database are selected for testing,k-nearest neighbor(KNN) classifier is used for classification and evaluation,fitness value and accuracy are used as evaluation criteria,and K-fold crossover verification is used to overcome the over-fitting problem.In the experiment,a variety of classical algorithms and advanced algorithms,including the FPA algorithm,are compared.The experimental results show that the GIFPA algorithm has strong competitiveness in feature selection.

Key words: Feature selection, FPA, GWO, Optimizer, RelifF

CLC Number: 

  • TP391
[1] ZAWBAA H M,EMARY E,GROSAN C.Feature Selection via Chaotic Antlion Optimization[J].Plos One,2016,11(3):e0150652.
[2] JIN X M,HUA W Q.Resource Management for Mobile Cloud Computing Energy Consumption Optimization[J].Computer Science,2020,47(6):253-257.
[3] LIU Y,CHAI Y,LIU B,et al.Bearing Fault Diagnosis Based on Energy Spectrum Statistics and Modified Mayfly Optimization Algorithm[J].Sensors,2021,21(6):2245.
[4] RAVI K,MALLIDI S,SANTOSH J K,et al.Bat optimizationalgorithm for wrapper-based feature selection and performance improvement of android malware detection[J].IET Networks,2021:1-10.
[5] FENG Y,WANG G G,DEB S,et al.Solving 0-1 knapsack problem by a novel binary monarch butterfly optimization[J].Neural Computing and Applications,2017,28(7):1-16.
[6] SALEHI M,FARHADI S,MOIENI A,et al.A hybrid modelbased on general regression neural network and fruit fly optimization algorithm for forecasting and optimizing paclitaxel biosynthesis in Corylus avellana cell culture[J].Plant Methods,2021,17(1):13.
[7] TUBISHAT M,JA'AFAR S,ALSWAITTI M,et al.Dynamic Salp Swarm Algorithm for Feature Selection[J].Expert Systems with Applications,2020,147:113873.
[8] ARORA S,ANAND P.Binary butterfly optimization approaches for feature selection[J].Expert Systems with Application,2019,116(FEB.):147-160.
[9] BHATTACHARYYA T,CHATTERJEE B,SINGH P K,et al.Mayfly in Harmony:A New Hybrid Meta-Heuristic Feature Selection Algorithm[J].IEEE Access,2020,8:195929-195945.
[10] WANG D,CHEN H,LI T,et al.A novel quantum grasshopper optimization algorithm for feature selection[J].International Journal of Approximate Reasoning,2020,127:33-53.
[11] CHEN H W,HU Z,HAN L,et al.A Spark-based Distributed Whale Optimization Algorithm for Feature Selection[C]//The 10th IEEE International Conference on Intelligent Data Acquisition and Advanced Computing Systems:Technology and Applications.IEEE,2019:70-74.
[12] FARIS H,MAFARJA M M,HEIDARI A A,et al.An Efficient Binary Salp Swarm Algorithm with Crossover Scheme for Feature Selection Problems[J].Knowledge-Based Systems,2018,154(Aug.15):43-67.
[13] YAN C,MA J,LUO H,et al.A hybrid algorithm based on binary chemical reaction optimization and tabu search for feature selection of high-dimensional biomedical data[J].Tsinghua Science and Technology,2018,23(6):733-743.
[14] SHI L,WAN Y C,GAO X J,et al.Feature Selection for Object-Based Classification of High-Resolution Remote Sensing Images Based on the Combination of a Genetic Algorithm and Tabu Search[J].Computational Intelligence and Neuroscience,2018,2018.
[15] WANG M,LIN J,YUE L,et al.Compensation for mobile ca-rrier magnetic interference in a SQUID-based full-tensor magnetic gradiometer using the flower pollination algorithm[J].Measurement Science and Technology,2021,32(8):085010.
[16] POA B,SC A,CYT A,et al.Prediction of tea theanine content using near-infrared spectroscopy and flower pollination algorithm-ScienceDirect[J].Spectrochimica Acta Part A:Molecular and Biomolecular Spectroscopy,2021,255.
[17] ANDERSEN C M,BRO R.Practical aspects of PARAFAC mo-deling of fluorescence excitation-emission data[J].Journal of Chemometrics,2010,17(4):200-215.
[18] JUNG D.Distributed Feature Selection for Multi-Class Classification Using ADMM[J].IEEE Control Systems Letters,2020,5(3):821-826.
[19] CHANDRASHEKAR G,SAHIN F.A survey on feature selection methods[J].Computers & Electrical Engineering,2014,40(1):16-28.
[20] JIMÉNEZ-CORDERO A,MORALES J M,PINEDA S.A novel embedded min-max approach for feature selection in nonlinear Support Vector Machine classification[J].European Journal of Operational Research,2021,293(1):24-35.
[21] SM A,SMM B,AL A.Grey Wolf Optimizer[J].Advances in Engineering Software,2014,69:46-61.
[22] SUNNY S,JAYARAJ P B.FPDock:Protein-Protein DockingUsing Flower Pollination Algorithm[J].Computational Biology and Chemistry,2021,93(2):107518.
[23] RAO R V.Jaya:A simple and new optimization algorithm forsolving constrained and unconstrained optimization problems[J].International Journal of Industrial Engineering Computations,2016,7(1934):19-34.
[24] YANG X S.Flower Pollination Algorithm for Global Optimization[C]//International Conference on Unconventional Computing and Natural Computation.Berlin:Springer,2012:240-249.
[25] MIRJALILI S,MIRJALILI S M,YANG X S.Binary bat algorithm[J].Neural Computing & Applications,2014,25(3/4):663-681.
[26] MIRJALILI S,MIRJALILI S M,HATAMLOU A.Multi-Verse Optimizer:a nature-inspired algorithm for global optimization[J].Neural Computing and Applications,2015,27(2):495-513.
[27] SOUZA R,COELHO L,MACEDO C,et al.A V-Shaped Binary Crow Search Algorithm for Feature Selection[C]//2018 IEEE Congress on Evolutionary Computation(CEC).IEEE,2018:1-8.
[28] HUSSIEN A G,HASSANIEN A E,HOUSSEIN E H,et al.S-shaped Binary Whale Optimization Algorithm for Feature Selection[M]//Recent Trends in Signal and Image Processing.Singapore:Springer,2019:79-87.
[29] MAFARJA M,JARRAR R,AHMAD S,et al.Feature Selection Using Binary Particle Swarm Optimization with Time Varying Inertia Weight Strategies[C]//International Conference on Future Networks & Distributed Systems.2018:1-9.
[30] ABDEL-BASSET M,EL-SHAHAT D,EL-HENAWY I,et al.A new fusion of grey wolf optimizer algorithm with a two-phase mutation for feature selection[J].Expert Systems with Application,2020,139(Jan.):112824.1-112824.14.
[1] LI Bin, WAN Yuan. Unsupervised Multi-view Feature Selection Based on Similarity Matrix Learning and Matrix Alignment [J]. Computer Science, 2022, 49(8): 86-96.
[2] HU Yan-yu, ZHAO Long, DONG Xiang-jun. Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification [J]. Computer Science, 2022, 49(7): 73-78.
[3] FAN Xing-ze, YU Mei. Coverage Optimization of WSN Based on Improved Grey Wolf Optimizer [J]. Computer Science, 2022, 49(6A): 628-631.
[4] CHU An-qi, DING Zhi-jun. Application of Gray Wolf Optimization Algorithm on Synchronous Processing of Sample Equalization and Feature Selection in Credit Evaluation [J]. Computer Science, 2022, 49(4): 134-139.
[5] SUN Lin, HUANG Miao-miao, XU Jiu-cheng. Weak Label Feature Selection Method Based on Neighborhood Rough Sets and Relief [J]. Computer Science, 2022, 49(4): 152-160.
[6] LI Zong-ran, CHEN XIU-Hong, LU Yun, SHAO Zheng-yi. Robust Joint Sparse Uncorrelated Regression [J]. Computer Science, 2022, 49(2): 191-197.
[7] ZHANG Ye, LI Zhi-hua, WANG Chang-jie. Kernel Density Estimation-based Lightweight IoT Anomaly Traffic Detection Method [J]. Computer Science, 2021, 48(9): 337-344.
[8] YANG Lei, JIANG Ai-lian, QIANG Yan. Structure Preserving Unsupervised Feature Selection Based on Autoencoder and Manifold Regularization [J]. Computer Science, 2021, 48(8): 53-59.
[9] HOU Chun-ping, ZHAO Chun-yue, WANG Zhi-peng. Video Abnormal Event Detection Algorithm Based on Self-feedback Optimal Subclass Mining [J]. Computer Science, 2021, 48(7): 199-205.
[10] HU Yan-mei, YANG Bo, DUO Bin. Logistic Regression with Regularization Based on Network Structure [J]. Computer Science, 2021, 48(7): 281-291.
[11] ZHOU Gang, GUO Fu-liang. Research on Ensemble Learning Method Based on Feature Selection for High-dimensional Data [J]. Computer Science, 2021, 48(6A): 250-254.
[12] DING Si-fan, WANG Feng, WEI Wei. Relief Feature Selection Algorithm Based on Label Correlation [J]. Computer Science, 2021, 48(4): 91-96.
[13] TENG Jun-yuan, GAO Meng, ZHENG Xiao-meng, JIANG Yun-song. Noise Tolerable Feature Selection Method for Software Defect Prediction [J]. Computer Science, 2021, 48(12): 131-139.
[14] ZHANG Ya-chuan, LI Hao, SONG Chen-ming, BU Rong-jing, WANG Hai-ning, KANG Yan. Hybrid Artificial Chemical Reaction Optimization with Wolf Colony Algorithm for Feature Selection [J]. Computer Science, 2021, 48(11A): 93-101.
[15] DONG Ming-gang, HUANG Yu-yang, JING Chao. K-Nearest Neighbor Classification Training Set Optimization Method Based on Genetic Instance and Feature Selection [J]. Computer Science, 2020, 47(8): 178-184.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!