基于Hadoop平台的高阶矩阵相乘MapReduce算法研究

计算机科学 ›› 2013, Vol. 40 ›› Issue (Z6): 96-98.

基于Hadoop平台的高阶矩阵相乘MapReduce算法研究

向林泓,陈芋文,张昱琳

重庆绿色智能技术研究院重庆404100;重庆绿色智能技术研究院重庆404100;重庆绿色智能技术研究院重庆404100

出版日期:2018-11-16 发布日期:2018-11-16
基金资助:
本文受农情气象专家决策系统技术研发(cstc2012gg-yyjs0606),重庆市科技攻关重大项目基于国产CPU平台的“办公云”关键技术研究与应用示范(cstc2011ggC40010)资助

High Order Matrix Multiplication by MapReduce Algorithm Based on Hadoop Platform

XIANG Lin-hong,CHEN Yu-wen and ZHANG Yu-lin

Online:2018-11-16 Published:2018-11-16

摘要/Abstract

摘要： 目前,针对基于单一节点的中高阶矩阵相乘存在着计算瓶颈,甚至因内存溢出导致计算机崩溃等问题,结合利用云计算分布式处理和虚拟化技术的优势,提出一种基于Hadoop平台的高阶矩阵相乘的MapReduce算法。实验结果表明:该算法能够有效地解决高阶矩阵相乘中存在的计算瓶颈问题,同时提高了计算效率。

关键词: MapReduce,高阶矩阵相乘,云计算,Hadoop平台

Abstract: Currently,high-order matrix multiplication using single-node computer causes computational bottlenecks and even leads the computer to crash for memory overflow．Taking advantage of distributed processing and virtualization technology from cloud computing,this paper presented a new method of high-order matrix multiplication by MapReduce based on Hadoop platform．The experimental results show that this algorithm can solve the computational bottlenecks with respect to high order matrix multiplication matrix and improve computational efficiency accordingly.

Key words: MapReduce,High-order matrix multiplication,Cloud computing,Hadoop platform

向林泓,陈芋文,张昱琳. 基于Hadoop平台的高阶矩阵相乘MapReduce算法研究[J]. 计算机科学, 2013, 40(Z6): 96-98. https://doi.org/

XIANG Lin-hong,CHEN Yu-wen and ZHANG Yu-lin. High Order Matrix Multiplication by MapReduce Algorithm Based on Hadoop Platform[J]. Computer Science, 2013, 40(Z6): 96-98. https://doi.org/

参考文献

[1] Hadoop W-K[EB/OL].http://en.wikipedia.org/wiki/Hado-op,2012-02-21
[2] Nutch W-K[EB/OL]．http://ca.wikipedia.org/wiki/Nutch,2012-02-21
[3] Ghemawats,Gobioffh,Leungst．The google file system.[EB/OL].Http://labs.google.com.hk/papers/gfs.html,2012-02-21
[4] Jean D,Ghemawats．Map/Reduce:simplified data processing on large clusters [EB/OL]．http://userpages.uni-koblenz.de/~laemmel/MapReduce/paper.pdf,2012-02-21
[5] Map/Reduce [EB/OL]．http://en.wikipedia.org/wiki/MapReduce,2012-02-21
[6] Applications powered by Hadoop [EB/OL]．Http://wiki.apa-che.org.hadoop/PoweredBy,2012-02-21
[7] Schlossers,Lin J．Hadoop Summit 2008[R/OL]．Http://developer.yahoo.com/events/hadoopsummmit2010/agenda.html,2012-02-21
[8] Zaharia M,Konwinski A,Anthony D．Improving mapreduce performance in heterogeneous environments[C]∥8^th USENIX Symposium On Operating Systems Design and Implementation．Washingtom,DC:IEEE,2008,1:29-42
[9] 刘鹏,黄宜华,陈卫卫．实战Hadoop——开起通向云计算的捷径 [M]．北京:电子工业出版社,2011
[10] 矩阵乘法 Wi-ki[EB/OL].http://zh.wikipedia.org/wiki/矩阵乘法,2012-02-21
[11] White T,Cutting D．Hadoop权威指南 [M]．北京:清华大学出版社,2011
[12] 刘鹏．云计算 [M]．北京:电子工业出版社,2011

Metrics

Viewed

Full text

Abstract

Cited

Shared

Discussed