基于云计算的受限玻尔兹曼机推荐算法研究

计算机科学 ›› 2013, Vol. 40 ›› Issue (12): 259-263.

基于云计算的受限玻尔兹曼机推荐算法研究

郑志蕴,李步源,李伦,李钝

郑州大学信息工程学院郑州450001;郑州大学信息工程学院郑州450001;郑州大学信息工程学院郑州450001;郑州大学信息工程学院郑州450001

出版日期:2018-11-16 发布日期:2018-11-16

Research on Restricted Boltzmann Machines Recommendation Algorithm Based on Cloud Computing

ZHENG Zhi-yun,LI Bu-yuan,LI Lun and LI Dun

Online:2018-11-16 Published:2018-11-16

摘要/Abstract

摘要： 数据的指数级增长及算法本身的复杂性使受限玻尔兹曼机面临着计算效率的问题。在详细分析受限玻尔兹曼机的基础上,将受限玻尔兹曼机与Hadoop平台的并行计算架构相结合,提出基于云平台的受限玻尔兹曼机推荐算法。该算法通过复制机制解决数据相关性问题,并将传统的受限玻尔兹曼机过程分解为若干个Hadoop任务的循环,实现并行计算。实验结果表明,与在传统平台上的实现相比,基于Hadoop并行架构的受限玻尔兹曼机推荐算法在大体量数据集的条件下可大幅提高推荐计算效率。

关键词: 协同过滤,受限玻尔兹曼机,并行处理,云计算,Hadoop

Abstract: Coupled with the exponential expansion of the data and the high computational complexity of Restricted Boltzmann Machines,efficient computing of Restricted Boltzmann Machines has become an important issue．Based on the detailed analysis,the article introduced Hadoop platform into Restricted Boltzmann Machines,and proposed Restricted Boltzmann Machines recommendation algorithm on cloud platform．The algorithm solves the problem of data correlation with replication mechanism,and divides traditional Restricted Boltzmann Machines process into several Hadoop jobs which implements parallel computing．In the experiments,the comparative analysis between Hadoop platform implementation and the previous implementation draws the conclusion that the Hadoop platform improves Restricted Boltzmann Machines computation efficiently under conditions of large data sets.

Key words: Collaborative filtering,Restricted boltzmann machines,Parallel processing,Cloud computing,Hadoop

郑志蕴,李步源,李伦,李钝. 基于云计算的受限玻尔兹曼机推荐算法研究[J]. 计算机科学, 2013, 40(12): 259-263. https://doi.org/

ZHENG Zhi-yun,LI Bu-yuan,LI Lun and LI Dun. Research on Restricted Boltzmann Machines Recommendation Algorithm Based on Cloud Computing[J]. Computer Science, 2013, 40(12): 259-263. https://doi.org/

参考文献

[1] 范波,程久军.用户间多相似度协同过滤推荐算法[J].计算机科学,2012(1):23-26
[2] 张光卫,李德毅,李鹏,等.基于云模型的协同过滤推荐算法[J].软件学报,2007(10):2403-2411
[3] 许海玲,吴潇,李晓东,等.互联网推荐系统比较研究[J].软件学报,2009(2):350-362
[4] 马宏伟,张光卫,李鹏.协同过滤推荐算法综述[J].小型微型计算机系统,2009(7):1282-1288
[5] 李乔,郑啸.云计算研究现状综述[J].计算机科学,2011(04):32-37
[6] Salakhutdinov R,Mnih A,Hinton G．Restricted Boltzmann Machines for Collaborative Filtering[C]∥Proceedings of the 24^th International Conference on Machine Learning．2007:791-798
[7] Hinton G．A Practical Guide to Training Restricted BoltzmannMachines[EB/OL].http://www.cs．toronto.edu/~hinton/absps/guideTR.pdf,2010-08-02
[8] Fischer A,Igel C.An Introduction to Restricted Boltzmann Machines[C]∥Progress in Pattern Recognition,Image Analysis,Computer Vision and Applications．2012:14-36
[9] Cueto M A,Morton J,Sturmfels B．Geometry of the Restricted Boltzmann Machine[C]∥AMS Special Session on Algebraic Methods in Statistics and Probability．2010,6:135-153
[10] Jeffrey D,Sanjay G．Mapreduce:Simplified data processing on large clusters[C]∥Proceedings of the Sixth Symposium on Operating Systems Design and Implementation．2004:137-149
[11] Apache HDFS Architecture[EB/OL].http://hadoop．apache.org/docs/hdfs/current/dfs_design.html,2011-04-12

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed