Computer Science ›› 2018, Vol. 45 ›› Issue (6A): 411-414.

• Big Date & Date Mining • Previous Articles     Next Articles

Cloud Resource Selection Algorithm by Skyline under MapReduce Frame

QI Yu-dong,HE Cheng,SI Wei-chao   

  1. Naval Aeronautical Engineering Institute,Yantai,Shandong 264001,China
  • Online:2018-06-20 Published:2018-08-03

Abstract: This paper researched a cloud resource selected algorithm under the MapReduce frame,which uses a method of possibility filtrate to figure the possibility of a resource nod belonging to the Skyline results set.It filtrates information by value seted in advance,to reduce the frequency of heartbeat in the MapReduce frame eventually,to optimize the flow of network.

Key words: MapReduce, Network majorization, Resource selection, Skyline

CLC Number: 

  • TP391
[1]朱琳,关佶红,周水庚.Skyline计算研究综述[J].计算机工程与应用,2008,44(6):160-165.
[2]BORZSONYI S,KOSSMANN D,STOCKER K.The Skyline operator[C]∥IEEE International Conference on Data Engineering(ICDE).2001:421-430.
[3]魏小娟,杨婧,李翠平,等.Skyline查询处理[J].软件学报,2008,19(6):1386-1400.
[4]PAPADIAS D,TAO Y,FU G,SEEGER B.ProgressiveSkyline computation in database system[J].ACM Transcations on Database System,2005,30(1):41-82.
[5]姜罕盛.云环境下数据安置策略与Skyline查询研究[D].天津:天津理工大学,2014.
[6]王媛,王意洁,邓瑞鹏,等.云计算环境下的容错并行Skyline查询算法研究[J].计算机科学与探索,2011,5(9):804-814.
[7]张波良,周水庚,关佶红.MapReduce框架下的Skyline计算[J].计算机科学与探索,2011,5(5):385-397.
[8]史恒亮.云计算任务调度研究[D].南京:南京理工大学,2012.
[9]范东来.Hadoop海量数据处理技术详解与项目实战[M].北京:人民邮电出版社,2016.
[10]关国栋.Hadoop容错调度技术研究[D].成都:西南交通大学,2016.
[11]DEAN J.Sanjay Ghem awant.MapReduce:simplified data processing on large clusters[M].ACM,2008:1-27.
[12]TAN K L,ENG P K,OOI B C.Efficient progressive Skyline computation[C]∥Proc of VLDB.2001:301-310.
[13]陈敏.OPNET网络仿真[M].北京:清华大学出版社,2004.
[14]DESHPANDE A,GUESTRIN C,HONG W,et al.Exploiting correlated attributes in acquisitional query processing[C]∥21st International Conference on Data Engineering.Washington,USA,2005:143-154.
[1] LIU Wei-ming, AN Ran, MAO Yi-min. Parallel Support Vector Machine Algorithm Based on Clustering and WOA [J]. Computer Science, 2022, 49(7): 64-72.
[2] ZHU Run-ze, QIN Xiao-lin, LIU Jia-chen. Study on Why-not Problem in Skyline Query of Road Network Based on Query Object [J]. Computer Science, 2021, 48(6): 57-62.
[3] ZHANG Yuan-ming, YU Jia-rui, JIANG Jian-bo, LU Jia-wei, XIAO Gang. Intermediate Data Transmission Pipeline Optimization Mechanism for MapReduce Framework [J]. Computer Science, 2021, 48(2): 41-46.
[4] WANG Yan, HAN Xiao, ZENG Hui, LIU Jing-xin, XIA Chang-qing. Task Migration Node Selection with Reliable Service Quality in Edge Computing Environment [J]. Computer Science, 2020, 47(10): 240-246.
[5] WANG Tong, MA Wen-ping, LUO Wei. Information Sharing and Secure Multi-party Computing Model Based on Blockchain [J]. Computer Science, 2019, 46(9): 162-168.
[6] ZHOU Jian-gang, QIN Xiao-lin, ZHANG Ke-heng, XU Jian-qiu. Dynamic Skyline Query for Multiple Mobile Users Based on Road Network [J]. Computer Science, 2019, 46(9): 73-78.
[7] WEI Liang, LIN Zi-yu, LAI Yong-xuan. DFTS:A Top-k Skyline Query for Large Datasets [J]. Computer Science, 2019, 46(5): 150-156.
[8] WANG Xiao-xia, SUN De-cai. Q-sample-based Local Similarity Join Parallel Algorithm [J]. Computer Science, 2019, 46(12): 38-44.
[9] HU Ying-shuang, LU Yi-hong. Cell Clustering Algorithm Based on MapReduce and Strongly Connected Fusion [J]. Computer Science, 2019, 46(11A): 204-207.
[10] ZHANG Bin, LE Jia-jin. Hash Join in MapReduce Distributed Environment Based on Column-store [J]. Computer Science, 2018, 45(6A): 471-475.
[11] ZHOU Hua-ping, LIU Guang-zong and ZHANG Bei-bei. Load Balancing Strategy of MapReduce Clustering Based on Index Shift [J]. Computer Science, 2018, 45(5): 303-309.
[12] WANG Hua-jin, LI Jian-hui, SHEN Zhi-hong and ZHOU Yuan-chun. ORC Metadata Based Reducer Load Balancing Method for Hive Join Queries [J]. Computer Science, 2018, 45(3): 158-164.
[13] MIAO Feng-yu, WANG Hong-zhi, RUAN Qun-sheng. Method of Similarity Join on Uncertain Graphs Using MapReduce [J]. Computer Science, 2018, 45(12): 299-307.
[14] YING Yi, REN Kai, LIU Ya-jun. Network Log Analysis Technology Based on Big Data [J]. Computer Science, 2018, 45(11A): 353-355.
[15] DING Yong, ZHU Chang-shui, WU Yu-yan. Association Rule Mining Algorithm Based on Hadoop [J]. Computer Science, 2018, 45(11A): 409-411.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!