Computer Science ›› 2021, Vol. 48 ›› Issue (1): 326-332.doi: 10.11896/jsjkx.191200030

• Interdiscipline & Frontier • Previous Articles    

Highly Available Elastic Computing Platform for Metagenomics

HE Zhi-peng1,2, LI Rui-lin1, NIU Bei-fang1,2   

  1. 1 Computer Network Information Center,Chinese Academy of Sciences,Beijing 100190,China
    2 University of Chinese Academy of Sciences,Beijing 100190,China
  • Received:2019-12-03 Revised:2020-03-09 Online:2021-01-15 Published:2021-01-15
  • About author:HE Zhi-peng,born in 1995,postgra-duate.His main research interests include high-performance computing and bioinformatics.
    NIU Bei-fang,born in 1978,Ph.D,professor,Ph.D supervisor,is a member of China Computer Federation.His main research interests include high-perfor-mance computing and bioinformatics.
  • Supported by:
    National Key R&D Program of China(2016YFC0503607),National Natural Science Foundation of China(31771466) and CAS 100-Talents(Dr. Beifang Niu).

Abstract: Next generation sequencing(NGS) has significantly promoted the development of metagenomics due to its low cost and ultra-high throughput.However,it has brought great challenges to researchers at the same time since processing large-scale and high-complexity sequencing data is a tough task.On the one hand,the analysis of large-scale sequencing data consumes too many resources such as hardware resources and the cost of time,etc.On the other hand,in the process of computational analysis,a large number of metagenomics computational analysis tools need to be deployed,debugged and maintained inevitably which are difficult for common users.For the above reasons,this paper compares the mainstream metagenomics computing platforms in the field and analyzes the main advantages and disadvantages of each platform comprehensively.Furthermore,a highly available and flexible metagenomics computing platform MWS-MGA(More than a Web Service for Metagenomic Analysis) focusing on meta-genomics computational analysis has been constructed which is combined with the current effective computing service technology.Meanwhile,not only multiple interactive access methods but also rich and flexible computing tools are provided in MWS-MGA.Thus,the scientific research threshold for researchers to conduct metagenomics analysis has been greatly reduced.

Key words: Computing platform, Elastic, High availability, Metagenomics, Microservices

CLC Number: 

  • TP399
[1] WOOLEY J C,GODZIK A,FRIEDBERG I,et al.A Primer on Metagenomics[J].Plos Computational Biology,2010,6(2):e1000667.
[2] SCHLOSS P D,JENIOR M L,KOUMPOURAS C C,et al.Sequencing 16S rRNA gene fragments using the PacBio SMRT DNA sequencing system[J].PeerJ,2016,4:e1869.
[3] CHIU C Y,MILLER S A.Clinical metagenomics[J].Nat. Rev. Genet.,2019,20(6):341-355.
[4] COSTA M,WEESE J S.Methods and basic concepts for microbiota assessment[J].The Veterinary Journal,2019,249:10-15.
[5] SESHADRI R,KRAVITZ S A,SMARR L.CAMERA:a community resource for metagenomics[J].Plos Biology,2007,5(3):e75.
[6] MITCHELL A L,SCHEREMETJEW M,DENISE H,et al.EBI Metagenomics in 2017:enriching the analysis of microbial communities,from sequence reads to assemblies[J].Nucleic Acids Research,2018,46(D1):D726-D735.
[7] CHEN I M A,CHU K,PALANIAPPAN K,et al.IMG/M v.5.0:an integrated data management and comparative analysis system for microbial genomes and microbiomes[J].Nucleic Acids Research,2019,47(D1):D666-D677.
[8] MEYER F,PAARMANN D,D'SOUZA M,et al.The met-agenomics RAST server-a public resource for the automatic phylogenetic and functional analysis of metagenomes[J].BMC Bioinformatics,2008,9(1):386.
[9] WU S,ZHU Z,FU L,et al.WebMGA:a customizable web ser-ver for fast metagenomic sequence analysis[J].BMC Genomics,2011,12(1):444.
[10] RODRIGUEZ A.Restful web services:The basics[J].IBM Developer Works,2008,33:18.
[11] NAMIOT D,SNEPS-SNEPPE M.On micro-services architec-ture[J].International Journal of Open Information Technologies,2014,2(9):24-27.
[12] CHESHIRE S,KROCHMAL M.DNS-based service discovery:RFC 6763[R].2013.
[13] HUNT P,KONAR M,JUNQUEIRA F P,et al.ZooKeeper:Wait-free Coordination for Internet-scale Systems[C]//USENIX Annual Technical Conference.2010:11.
[14] CoreOS.etcd[EB/OL].https://coreos.com/etcd.
[15] HashiCorp.Introduction to Consul[EB/OL].https://www.con-sul.io/intro/index.html.
[16] ZHUAN G X.Design Example of API Gateway Architecture[J].China CIO News,2018,293(5):99-100.
[17] Netflix.Announcing Zuul:Edge service in the cloud[EB/OL].http://techblog.netflix.com/201 3/06/announcing-zuul-edge-service-in-cloud.html.
[18] Spring.Spring Cloud Gateway[EB/OL].https://spring.io/projects/spring-cloud-gateway.
[19] Kong.Kong:Next-Generation API platform for Microservices[EB/OL].https://konghq.com.
[20] CHRISTAKIS C,POLYMENAKOU P N,KILIAS S P,et al.What do I do with my metagenomes? A comparison of three online metagenomic analysis platforms[C]//Hellenic Bioinforma-tics.Thessaloniki:Biogeochemical Cycles,2018.
[1] DENG Li, WU Jin-da, LI Ke-xue, LU Ya-kang. SpaRC Algorithm Hyperparameter Optimization Methodology Based on TPE [J]. Computer Science, 2021, 48(2): 70-75.
[2] WANG Tao, ZHANG Shu-dong, LI An, SHAO Ya-ru, ZHANG Wen-bo. Anomaly Propagation Based Fault Diagnosis for Microservices [J]. Computer Science, 2021, 48(12): 8-16.
[3] ZHU Han-qing, MA Wu-bin, ZHOU Hao-hao, WU Ya-hui, HUANG Hong-bin. Microservices User Requests Allocation Strategy Based on Improved Multi-objective Evolutionary Algorithms [J]. Computer Science, 2021, 48(10): 343-350.
[4] XIE Wen-kang, FAN Wei-bei, ZHANG Yu-jie, XU He, LI Peng. ENLHS:Sampling Approach to Auto Tuning Kafka Configurations [J]. Computer Science, 2020, 47(8): 119-126.
[5] JIA Yu-fu, LI Ming-lei, LIU Wen-ping, HU Sheng-hong, JIANG Hong-bo. Group Perception Analysis Method Based on WiFi Dissimilarity [J]. Computer Science, 2020, 47(10): 63-68.
[6] WU Bin-feng. Design of IoT Middleware Based on Microservices Architecture [J]. Computer Science, 2019, 46(6A): 580-584.
[7] SHEN Yan-ping, GU Su-hang, ZHENG Li-xia. Bionic Optimized Clustering Data Mining Algorithm Based on Cloud Computing Platform [J]. Computer Science, 2019, 46(11): 247-250.
[8] YANG Dong-ju and FENG Kai. Distributed and Unified Authentication Optimization Mechanism Based on Cache [J]. Computer Science, 2018, 45(3): 300-304.
[9] XU Xin-li, CHEN Chen, HUANGFU Xiao-jie and CUI Yong-ting. Wireless Charging Scheduling Algorithm of Single Mobile Vehicle with Limited Energy [J]. Computer Science, 2018, 45(3): 108-114.
[10] HU Ya-zhou, DENG Bo, LIN Wang-qun, PENG Fu-yang and WANG Dong-xia. Study on Testing Cloud Computing Elasticity [J]. Computer Science, 2017, 44(7): 8-15.
[11] CHEN Lin, YING Shi and JIA Xiang-yang. SHMA:Monitoring Architecture for Clouds [J]. Computer Science, 2017, 44(1): 7-12.
[12] WANG Hui-qiang, DAI Xiu-hao, LV Hong-wu and LIN Jun-yu. Review and Prospect of Server Monitoring Technology [J]. Computer Science, 2016, 43(8): 1-6.
[13] CHENG Mao-cai and XU Kai-yong. Audit Log Secure Storage System Based on Trusted Computing Platform [J]. Computer Science, 2016, 43(6): 146-151.
[14] ZHENG Jian-wei, KONG Chen-chen, WANG Wan-liang, QIU Hong and ZHANG Hang-ke. Kernel-based Supervised Neighborhood Projection Analysis Algorithm [J]. Computer Science, 2016, 43(6): 312-315.
[15] JIN Lei, XU Kai-yong, LI Jian-fei and CHENG Mao-cai. Design of TCP Application Architecture for Network-oriented Information System [J]. Computer Science, 2015, 42(10): 154-158.
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!