关键词: 大数据,数据分析,数据挖掘,组件,分布式,服务,平台

Abstract: As the expansion of data size,the data analysis tools that run only on stand-alone computers are no longer sufficient．We designed and implemented a module based big data analysis platform named Haflow to solve this problem．In Haflow,we defined an analysis business model and an extensible module interface,which supports integration of heterogeneous tools．Users submit their analysis flows,and system will interpret them,and then commit to the Hadoop．Haflow is an extensible,distributed,heterogeneous supported,service oriented big data platform．The goal of the platform is twofold．First,it provides an platform that encapsulates the dummy jobs that have nothing to do with the business itself,improving the development speed of analysis applications．Second,by submitting jobs to Hadoop which can execute jobs concurrently,the platform decreases the mean time of the analysis applications.

Key words: Big data,Data analysis,Data mining,Module,Distributed,Service,Platform