计算机科学 ›› 2018, Vol. 45 ›› Issue (11A): 234-237.

• 模式识别与图像处理 • 上一篇    下一篇

高斯过程下的CMA-ES在医学图像配准中的应用

楼浩锋1, 张端2   

  1. 浙江工业大学信息工程学院 杭州3100231
    浙江工业大学计算机科学与技术学院 杭州3100232
  • 出版日期:2019-02-26 发布日期:2019-02-26
  • 通讯作者: 张 端(1972-),男,博士,副教授,主要研究方向为人工智能,E-mail:dzhang@zjut.edu.cn
  • 作者简介:楼浩锋(1993-),男,硕士生,CCF学生会员,主要研究方向为机器学习与医学图像处理
  • 基金资助:
    本文受国家自然科学基金(61374152),浙江省自然科学基金(LY16F030014)资助。

Gaussian Process Assisted CMA-ES Application in Medical Image Registration

LOU Hao-feng1, ZHANG Duan2   

  1. College of Information Engineering,Zhejiang University of Technology,Hangzhou 310023,China1
    College of Computer Science &Technology,Zhejiang University of Technology,Hangzhou 310023,China2
  • Online:2019-02-26 Published:2019-02-26

摘要: 为了改进协方差矩阵自适应进化策略(CMA-ES)的性能,提出了一种高斯过程协助下的协方差矩阵自适应进化策略(GPACMA-ES)。该策略利用CMA-ES中的协方差矩阵构建核函数,引入高斯过程,在线学习历史经验,并根据历史经验预测全局最优解的最有前景区域,有效地降低了适应度函数的评价次数。同时,为了提高群体的搜索效率,引入了置信区间。群体在置信区间内更高效地采样,使得算法具备更快的收敛速度和全局寻优能力。最后,将GPACMA-ES算法应用于医学图像配准中,配准精度和效率均高于标准的CMA-ES算法。

关键词: 高斯过程, 协方差矩阵自适应进化策略, 医学图像配准, 置信区间

Abstract: A gaussian process assisted covariance matrix adaptation evolution strategy(GPACMA-ES)optimization algorithm was proposed in this paper.The kernel function used in the GPACMA-ES algorithm is constructed by the cova-riance matrix.Taking advantage of the Gaussian process,which plays a key role in both online learning about the histo-ric experience and predicting the promising region which contains globally optimal solution,the frequency of calculating fitness function in the algorithm is reduced markedly.Meanwhile,in order to improve the efficiency of the algorithm,GPACMA-ES is sampling in the trust region.So it has rapid convergence and good global search capacity.Finally,a case study of medical image registration is examined to demonstrate the ability and applicability of the GPACMA-ES.Expe-riment results show that GPACMA-ES is proper for medical image registration than CMA-ES,and it has a better effect on the precision of registration while reducing the number of calculation of the fitness function.

Key words: Covariance matrix adaptation evolution strategy, Gaussian process, Medical image registration, Trust region

中图分类号: 

  • TP391
[1]LEGG P A,ROSIN P L,MARSHALL D,et al.Feature Neighbourhood Mutual Information for multi-modal image registration:An application to eye fundus imaging[J].Pattern Recognition,Elsevier,2015,48(6):1937-1946.
[2]SONG G,HAN J,ZHAO Y,et al.A Review on Medical Image Registration as an Optimization Problem[J].Current Medical Imaging Reviews,2017,13(3):274-283.
[3]PANDA R,AGRAWAL S,SAHOO M,et al.A novel evolutio-nary rigid body docking algorithm for medical image registration[J].Swarm & Evolutionary Computation,2017,33:108-118.
[4]WINTER S,BRENDEL B,PECHLIVANIS I,et al.Registration of CT and intraoperative 3-D ultrasound images of the spine using evolutionary and gradient-based methods[J].IEEE Tran-sactions on Evolutionary Computation,2008,12(3):284-296.
[5]刘哲,宋余庆,王栋栋.自适应变异差分算法与Powell算法相结合的医学图像配准[J].计算机科学,2017,44(11):297-300.
[6]HANSEN N.The CMA Evolution Strategy:A Tutorial[J/OL].http://www2.fiit.stuba.sk/~kvasnicka/Seminar_of_AI/Hansen_CMA_tutorial.pdf.
[7]李焕哲,吴志健,汪慎文,等.协方差矩阵自适应演化策略学习机制综述[J].电子学报,2017,45(1):238-245.
[8]NISHID K,AKIMOTO Y.Population Size Adaptation for the CMA-ES Based on the Estimation Accuracy of the Natural Gradient[C]∥Genetic and Evolutionary Computation Conference.ACM,2016:237-244.
[9]MOHAMMADI H,RICHE R L,TOUBOUL E.Making EGO and CMA-ES Complementary for Global Optimization[M]∥Learning and Intelligent Optimization.Springer International Publishing,2015:287-292.
[10]BOUZARKOUNA Z,AUGER A,DING D Y.Investigating the Local-Meta-Model CMAES for Large Population Sizes[M]∥Applications of Evolutionary Computation.Springer Berlin Heidelberg,2010:402-411.
[11]LOSHCHILOV I,SCHOENAUER M.Comparison-based optimizers need comparison-based surrogates[C]∥International Conference on Parallel Problem Solving From Nature.Springer-Verlag,2010:364-373.
[12]KRUISSELBRINK J W,EMMERICH M T M,DEUTZ A H,et al.A robust optimization approach using Kriging metamodels for robustness approximation in the CMAES[C]∥Evolutionary Computation.IEEE,2010:1-8.
[13]别术林.基于互信息的医学图像配准算法研究[D].北京:北京交通大学,2014.
[14]HANSEN N,OSTERMEIER A.Adapting arbitrary normal mutation distributions in evolution strategies:the covariance matrix adaptation[C]∥IEEE International Conference on Evolutionary Computation.IEEE,1996:312-317.
[15]HOWARD W R.Pattern Recognition and Machine Learning[M]∥Pattern Recognition and Machine Learning.Springer,2006:461-462.
[16]SEEGER M.Gaussian processes for machine learning[J].International Journal of Neural Systems,2004,14(2):69-106.
[17]LOSHCHILOV I,SCHOENAUER M,SEBAG M.Self-adaptive surrogate-assisted covariance matrix adaptation evolution strategy[C]∥Conference on Genetic and Evolutionary Computation.ACM,2012:321-328.
[18]SHAHRIARI B,SWERSKY K,WANG Z,et al.Taking the Human Out of the Loop:A Review of Bayesian Optimization[J].Proceedings of the IEEE,2015,104(1):1-24.
[19]SNOEK J,LAROCHELLE H,ADAMS R P.Practical bayesian optimization of machine learning algorithms[C]∥Advances in Neural Information Processing Systems.MIT Press,2012:2951-2959.
[20]COLLINS D L,ZIJDENBOS A P,KOLLOKIAN V,et al.Design and construction of a realistic digital brain phantom[J].IEEE Transactions on Medical Imaging,1998,17(3):463-468.
[1] 刘栅杉, 朱海龙, 韩晓霞, 穆全起, 贺维.
基于主成分回归和分层置信规则库的企业风险评估模型
Enterprise Risk Assessment Model Based on Principal Component Regression and HierarchicalBelief Rule Base
计算机科学, 2021, 48(11A): 570-575. https://doi.org/10.11896/jsjkx.201200038
[2] 张光园, 王宁.
基于小样本置信区间的众包答案决策方法
Truth Inference Based on Confidence Interval of Small Samples in Crowdsourcing
计算机科学, 2020, 47(10): 26-31. https://doi.org/10.11896/jsjkx.191100086
[3] 黄熠,王娟.
PSO-GP中文文本情感分类方法研究
Research on Chinese Texts Sentiment Classification Approach Based on PSO-GP
计算机科学, 2017, 44(Z6): 446-450. https://doi.org/10.11896/j.issn.1002-137X.2017.6A.100
[4] 华亮,丁立军,黄宇,冯浩,顾菊平.
Clifford 代数几何不变量3D医学图像配准的方法
Approach for 3D Medical Image Registration Based on Clifford Algebra Geometrical Invariance
计算机科学, 2014, 41(6): 304-308. https://doi.org/10.11896/j.issn.1002-137X.2014.06.061
[5] 党建武,杭利华,王阳萍,杜晓刚.
基于GPU的2D-3D医学图像配准
2D-3D Medical Image Registration Based on GPU
计算机科学, 2013, 40(4): 306-309.
[6] 杜占玮 杨永健 肖敏 白媛.
一种基于自适应高斯过程的基线计算算法
Baseline Algorithm Based on Adaptive Gaussian Process Machine Learning
计算机科学, 2012, 39(11): 79-82.
[7] 李雄飞,张存利,李鸿鹏,减雪柏.
医学图像配准技术进展
Development of Medical Image Registration Technology
计算机科学, 2010, 37(7): 27-33.
[8] 刘长红,杨扬,陈勇.
增量式人体姿态映射模型的学习方法
Incrementally Learning Human Pose Mapping Model
计算机科学, 2010, 37(3): 268-270.
[9] 田江,顾宏.
一种孤立点挖掘的混合核方法
Hybrid Method for Outliers Detection Using GPLVM and SVM
计算机科学, 2010, 37(3): 245-247.
[10] 康晓东,孙越恒,乔清理,于瑞国,李昌青.
一种基于小波与概率估计的医学图像配准方法
Medical Image Registration Methods Based on Wavelet Transformation and Probability Estimate
计算机科学, 2009, 36(9): 281-282.
[11] 周文云,刘全,李志涛.
一种大规模离散空间中的高斯强化学习方法
Gaussian Processes Reinforcement Learning Method in Large Discrete States Space
计算机科学, 2009, 36(8): 247-249.
[12] 朱焱.
应用模糊分析层次法可靠评测Web资源质量

计算机科学, 2009, 36(4): 221-223.
[13] 王秀美 高新波.
基于判别特征加权的GPLVM算法

计算机科学, 2009, 36(3): 189-192.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!