计算机科学 ›› 2021, Vol. 48 ›› Issue (8): 220-225.doi: 10.11896/jsjkx.200900045

• 人工智能 • 上一篇    下一篇

DragDL:一种易用的深度学习模型可视化构建系统

汤世征, 张岩峰   

  1. 东北大学计算机科学与工程学院 沈阳110000
  • 收稿日期:2020-09-05 修回日期:2020-12-18 发布日期:2021-08-10
  • 通讯作者: 张岩峰(zhangyf@mail.neu.edu.cn)
  • 基金资助:
    国家自然科学基金(61672141);辽宁省重点研发计划(2020JH2/10100037);中央高校基本科研业务费(N181605017,N181604016)

DragDL:An Easy-to-Use Graphical DL Model Construction System

TANG Shi-zheng, ZHANG Yan-feng   

  1. School of Computer Science and Engineering,Northeastern University,Shenyang 110000,China
  • Received:2020-09-05 Revised:2020-12-18 Published:2021-08-10
  • About author:TANG Shi-zheng,born in 1994,postgraduate.His main research interests include data mining and deep learning.(tangsz1023@qq.com)ZHANG Yan-feng,born in 1982,professor,Ph.D supervisor,is a senior member of China Computer Federation.His main research interests include big data mining,large-scale machine learning and distributed systems.
  • Supported by:
    National Natural Science Foundation of China(61672141),Key R&D Program of Liaoning Province(2020JH2/10100037)and Fundamental Research Funds for the Central Universities(N181605017,N181604016).

摘要: 深度学习在各个领域得到了普遍的应用,但是用户在应用深度学习时仍然面临两方面的问题:1)深度学习有着复杂的理论背景,非专业用户缺乏建模以及调优的背景知识,难以构建性能优化的模型;2)数据预处理、模型训练、预测等过程往往涉及比较复杂的编程实现,给没有程序设计基础的非专业用户在入门时带来了一定的困难。针对以上两点易用性问题,文中提出了一种易用的深度学习模型可视化构建系统DragDL,其目的在于降低用户进行数据预处理、模型训练、监控、在线预测等工作的难度。该系统基于PaddlePaddle框架,支持以拖拽图形算子的方式在画布上搭建深度学习网络结构以及推理预测功能,并将数据预处理操作过程抽象成数据流图展示,以方便用户理解和调试。系统还提供训练过程中的质量监控和性能监控的可视化功能,帮助用户实时观察训练情况。同时,DragDL提供经典模型库帮助用户完成建模任务,支持以微调经典模型的方式构建新的模型,降低用户建模时的难度。DragDL基于集群服务器和Web客户端进行部署,服务器为每个训练任务构建虚拟机服务,并支持大规模异步任务调度,具有一定的并发处理能力。

关键词: PaddlePaddle, 深度学习, 数据流图, 图形化编程, 预训练模型

Abstract: Deep learning has broad applications in various fields.However,users still need to face problems from two aspects when applying deep learning.First,deep learning has a complex theoretical background,non-professional users lack background knowledge in modeling and tuning.It is difficult for them to build performance-optimized models.Second,modules such as data preprocessing,model training,and prediction often involve more complicated programming implementations,which bring some difficulties in getting started for non-professional users who have no programming skill background.In view of the above two issues of usability,this paper proposes an easy-to-use graphical deep learning model construction system,DragDL.The purpose of DragDL is to reduce the difficulty of data preprocessing,model training,monitoring,online prediction and other tasks for users.The system is based on the PaddlePaddle framework and supports building a deep learning network structure on the canvas by dragging graphical operators,supporting inference and prediction functions,and abstracting the data preprocessing operation process into a dataflow graph,which is convenient for users to understand and debug.The system also provides visualization functions for performance monitoring during the training process.At the same time,DragDL provides a classic model library,which allows users to build new DL network by tuning the existing classic model network.DragDL is deployed based on a centralized server and Web client.The server provides a virtual machine service for submitted tasks and supports large-scale asynchronous task scheduling to have concurrent processing capabilities.

Key words: Dataflow graph, Deep learning, Graphical programming, PaddlePaddle, Pre-trained model

中图分类号: 

  • TP319
[1]PAI Studio[OL].https://data.aliyun.com/pai/studio.
[2]GUO T,XU J,YAN X,et al.Ease the process of machine lear-ning with dataflow[C]//Proceedings of the 25th ACM International Conference on Information and Knowledge Management (CIKM 2016).2016:2437-2440.
[3]PaddlePaddle[OL].https://www.PaddlePaddle.org.cn/.
[4]WANG W,GAO J,ZHANG M,et al.Rafiki:Machine learning as an analytics service system[J].Proceedings of the VLDB Endowment,2018,12(2):128-140.
[5]PaddleHub[OL].https://www.PaddlePaddle.org.cn/hub.
[6]ABADI M,BARHAM P,CHEN J,et al.Tensorflow:A system for large-scale machine learning[C]//Proceedings of the 12th USENIX Symposium on Operating Systems Design and Implementation (OSDI 2016).2016:265-283.
[7]SONKA M,HLAVAC V,BOYLE R.Image processing,analysis,and machine vision[M].United States:Cengage Learning,2014.
[8]AntV[OL].https://antv.vision/.
[9]YOSINSKI J,CLUNE J,BENGIO Y,et al.How transferable are features in deep neural networks?[C]//Proceedings of Advances in Neural Information Processing Systems (NIPS 2014).2014:3320-3328.
[10]HE K,ZHANG X,REN S,et al.Deep residual learning forimage recognition[C]//Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2016).2016:770-778.
[11]SIMONYAN K,ZISSERMAN A.Very deep convolutional networks for large-scale image recognition[J].arXiv:1409.1556,2014.
[12]LONG M,ZHU H,WANG J,et al.Deep transfer learning with joint adaptation networks[C]//International Conference on Machine Learning.2017:2208-2217.
[13]HOWARD J,RUDER S.Universal Language Model Fine-tuning for Text Classification[C]//Proceedings of the 56th Annual Meeting of the Association for Computational Linguistics.2018:328-339.
[14]CRANKSHAW D,WANG X,ZHOU G,et al.Clipper:a low-latency online prediction serving system[C]//Proceedings of the 14th USENIX Conference on Networked Systems Design and Implementation.2016:192-209.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[8] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[9] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[10] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[11] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[12] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[13] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
[14] 孙福权, 崔志清, 邹彭, 张琨.
基于多尺度特征的脑肿瘤分割算法
Brain Tumor Segmentation Algorithm Based on Multi-scale Features
计算机科学, 2022, 49(6A): 12-16. https://doi.org/10.11896/jsjkx.210700217
[15] 康雁, 徐玉龙, 寇勇奇, 谢思宇, 杨学昆, 李浩.
基于Transformer和LSTM的药物相互作用预测
Drug-Drug Interaction Prediction Based on Transformer and LSTM
计算机科学, 2022, 49(6A): 17-21. https://doi.org/10.11896/jsjkx.210400150
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!