计算机科学 ›› 2020, Vol. 47 ›› Issue (11): 310-315.doi: 10.11896/jsjkx.200400045

所属专题: 物联网技术 虚拟专题

• 计算机网络 • 上一篇    下一篇

面向物联网的时空数据处理算法设计

徐鹤1,2, 吴昊1, 李鹏1,2   

  1. 1 南京邮电大学计算机学院、软件学院、网络空间安全学院 南京 210023
    2 江苏省无线传感网高技术研究重点实验室 南京 210003
  • 收稿日期:2020-04-10 修回日期:2020-07-09 出版日期:2020-11-15 发布日期:2020-11-05
  • 通讯作者: 李鹏(lipeng@njupt.edu.cn)
  • 作者简介:xuhe@njupt.edu.cn
  • 基金资助:
    国家重点研发计划项目(2019YFB2103003,2018YFB1003201);国家自然科学基金(61672296,61602261,61872196,61872194,61902196);江苏省科技支撑计划项目(BE2017166,BE2019740);江苏省高等学校自然科学研究重大项目(18KJA520008);江苏省六大人才高峰高层次人才项目(RJFW-111)

Design of Temporal-spatial Data Processing Algorithm for IoT

XU He1,2, WU Hao1, LI Peng1,2   

  1. 1 School of Computer Science,Nanjing University of Posts and Telecommunications,Nanjing 210023,China
    2 Jiangsu High Technology Research Key Laboratory for Wireless Sensor Networks,Nanjing 210003,China
  • Received:2020-04-10 Revised:2020-07-09 Online:2020-11-15 Published:2020-11-05
  • About author:XU He,born in 1985,associate professor,master supervisor,is a member of China Computer Federation.His main research interests include Internet of Things (IoT) technology and applications.
    LI Peng,born in 1979,Ph.D,professor,master supervisor,is a member of China Computer Federation.His main research interests include computer communication networks,cloud computing,and information security.
  • Supported by:
    This work was supported by the National Key R&D Program of China (2019YFB2103003,2018YFB1003201),National Natural Science Foundation of P. R. China (61672296,61602261,61872196,61872194,61902196),Scientific and Technological Support Project of Jiangsu Province (BE2017166,BE2019740),Major Natural Science Research Projects in Colleges and Universities of Jiangsu Province (18KJA520008) and Six Ta-lent Peaks Project of Jiangsu Province (RJFW-111).

摘要: 随着物联网和5G技术的快速发展,以深度学习为基础的人工智能应用越来越多,使基于时空数据的医疗影像、城市安防、自动驾驶等视觉领域成为物联网方向的研究热点。物联网系统采集到的视频数据、图片数据、温湿度与气体浓度数据同时也急剧增长,最终使得物联网系统的处理速度和反馈速度越来越慢。针对物联网节点采集的时空数据量大且可能存在短暂性异常的问题,文中设计了基于长短记忆网络的EPLSN(Exception Processing Long and Short Memory Network)算法。首先,对输入门的逻辑结构进行设计,并对网络模型结构进行改进,解决了短暂性异常数据与时空数据分类的问题,提高了EPLSN算法对物联网时空数据的分类精度,并能够对异常数据进行数据清洗。其次,依据传感器采集的时空数据特点,将数据存储到不同的数据块中,采用时序数据库对时空数据进行短暂性存储,并提出基于时空数据的物联网搜索架构,加快了物联网系统搜索的速度。

关键词: 深度学习, 时空数据, 数据分类, 数据清洗, 物联网, 异常数据

Abstract: With the rapid development of Internet of Things (IoT) and 5G technology,there are more and more applications of artificial intelligence based on deep learning,which makes medical imaging,urban security,autonomous driving and other visual fields based on temporal-spatial data become research hotpots in the direction of IoT.At the same time,the video data,picture data,temperature and humidity data and gas concentration data collected by the IoT system also grow rapidly,which eventually makes the processing speed and feedback speed of the IoT system slower and slower.In view of the large amount of temporal-spatial data collected by IoT nodes and the problem of transient anomalies,this paper designs an EPLSN (Exception Processing Long and Short Memory Network) algorithm based on long and short memory network.This paper designs logic structure of the input gate and improves the network model structure,solving the problem of the classification of transient abnormal data and temporal-spatial data,improving the classification accuracy of the IoT temporal-spatial data,and cleaning the abnormal data.According to the characteristics of the temporal-spatial data collected by the IoT sensor,the data is stored in different data blocks.At the same time,a time-series database is used to temporarily store temporal-spatial data,and an IoT search architecture based on temporal-spatial data is proposed.The architecture is suitable for the real-time search system in IoT environment and accele-rates the search speed of the IoT system.

Key words: Abnormal data, Data classification, Data cleaning, Deep learning, Internet of Things, Temporal-spatial data

中图分类号: 

  • TP301.6
[1] ZHANG P N.Research on entity state matching estimationmethod for Internet of things search service [D].Beijing :Beijing University of Posts and Telecommunications,2017.
[2] ALMA Y A.Electricity Prices Forecasting using Artificial Neural Networks[J].IEEE Latin America Transactions,2018,16(1):105-111.
[3] XIA X,TOGNERI R,SOHEL F,et al.Random Forest Classification based Acoustic Event Detection Utilizing Contextual-Information and Bottleneck Features[J].Pattern Recognition,2018,81:1-13.
[4] WEBB G I,BOUGHTON J R,ZHENG F,et al.Learning by extrapolation from marginal to full-multivariate probability distributions:decreasingly naive Bayesian classification[J].Machine Learning,2012,86(2):233-272.
[5] WANG S,FAN C,HSU C,et al.A Vertical Handoff Method viaSelf-Selection Decision Tree for Internet of Vehicles[J].IEEE Systems Journal,2016,10(3):1183-1192.
[6] KOLETSI D,PANDIS N.Ordinal logistic regression[J].American Journal of Orthodontics and Dentofacial Orthopedics,2018,153(1):157-158.
[7] ZHANG S,LI X,ZONG M,et al.Efficient kNN Classification With Different Numbers of Nearest Neighbors[J].IEEE Transactions on Neural Networks & Learning Systems,2018,5(29):1-12.
[8] GU B,SHENG V S,TAY K Y,et al.Cross Validation Through Two-Dimensional Solution Surface for Cost-Sensitive SVM[J].IEEE Transactions on Pattern Analysis & Machine Intelligence,2017,39(6):1103-1121.
[9] HAN J,SEO H,CHOI Y,et al.Expression and regulation of inhibitor of DNA binding proteins ID1,ID2,ID3,and ID4 at the Maternal-Conceptus Interface in Pigs[J].Theriogenology,2018,108:46-55.
[10] CHERFI A,NOUIRA K,FERCHICHI A.Very Fast C4.5 Decision Tree Algorithm[J].Applied Artificial Intelligence,2018,3(3):1-19.
[11] FEDOROV I,RAO B D,NGUYEN T Q.Multimodal sparseBayesian dictionary learning applied to multimodal data classification[C]//2017 IEEE International Conference on Acoustics,Speech and Signal Processing (ICASSP).2017:2237-2241.
[12] WANG F,NIU L.An Improved BP Neural Network in Internet of Things Data Classification Application Research[C]//2016 IEEE Information Technology,Networking,Electronic and Automation Control Conference.2016:805-808.
[13] ZHANG J,WANG S,CHEN L,et al.Multiple Bayesian Dis-criminant Functions for High-Dimensional Massive Data Classification[J].Data Mining and Knowledge Discovery,2017,31(2):465-501.
[14] GAO Y D.Research on Internet of Things Entity Information Description and Search Technology based on Web [D].Beijing:North China Electric Power University,2016.
[15] GREFF K,SRIVASTAVA R K,JAN KOUTNÍK,et al.LSTM:A Search Space Odyssey[J].IEEE Transactions on Neural Networks and Learning Systems,2017,28(10):2222-2232.
[16] MORABITO R,COZZOLINO V,DING A Y,et al.Consolidate IoT Edge Computing with Lightweight Virtualization[J].IEEE Network,2018,32(1):102-111.
[17] LEIGHTON B,COX S,CAR N,et al.A Best of Both Worlds Approach to Complex,Efficient,Time Series Data Delivery[J].IFIP Advances in Information & Communication Technology,2015(448):371-379.
[18] BALIS B,BUBAK M,HAREZLAK D,et al.Towards an Operational Database for Real-time Environmental Monitoring and Early Warning systems[J].Procedia Computer Science,2017,108:2250-2259.
[19] ZHANG J,DU J,DAI L.A GRU-Based Encoder-Decoder Approach with Attention for Online Handwritten Mathematical Expression Recognition[C]//2017 14th IAPR International Conference on Document Analysis and Recognition (ICDAR).2017:902-907.
[20] ILIA K,MAXIM H,ANATOLII Z,et al.Putting Hands toRest:Efficient Deep CNN-RNN Architecture for Chemical Named Entity Recognition with No Hand-crafted Rules[J].Journal of Cheminformatics,2018,10(1):1-10.
[21] BU L Z,WANG H D,ZHU M Q,et al.Multi-source Digital Recognition based on Improved Convolutional Neural Network[J].Journal of Computer Applications,2018,38(12):3403-3408.
[1] 饶志双, 贾真, 张凡, 李天瑞.
基于Key-Value关联记忆网络的知识图谱问答方法
Key-Value Relational Memory Networks for Question Answering over Knowledge Graph
计算机科学, 2022, 49(9): 202-207. https://doi.org/10.11896/jsjkx.220300277
[2] 汤凌韬, 王迪, 张鲁飞, 刘盛云.
基于安全多方计算和差分隐私的联邦学习方案
Federated Learning Scheme Based on Secure Multi-party Computation and Differential Privacy
计算机科学, 2022, 49(9): 297-305. https://doi.org/10.11896/jsjkx.210800108
[3] 徐涌鑫, 赵俊峰, 王亚沙, 谢冰, 杨恺.
时序知识图谱表示学习
Temporal Knowledge Graph Representation Learning
计算机科学, 2022, 49(9): 162-171. https://doi.org/10.11896/jsjkx.220500204
[4] 王剑, 彭雨琦, 赵宇斐, 杨健.
基于深度学习的社交网络舆情信息抽取方法综述
Survey of Social Network Public Opinion Information Extraction Based on Deep Learning
计算机科学, 2022, 49(8): 279-293. https://doi.org/10.11896/jsjkx.220300099
[5] 郝志荣, 陈龙, 黄嘉成.
面向文本分类的类别区分式通用对抗攻击方法
Class Discriminative Universal Adversarial Attack for Text Classification
计算机科学, 2022, 49(8): 323-329. https://doi.org/10.11896/jsjkx.220200077
[6] 姜梦函, 李邵梅, 郑洪浩, 张建朋.
基于改进位置编码的谣言检测模型
Rumor Detection Model Based on Improved Position Embedding
计算机科学, 2022, 49(8): 330-335. https://doi.org/10.11896/jsjkx.210600046
[7] 黎嵘繁, 钟婷, 吴劲, 周帆, 匡平.
基于时空注意力克里金的边坡形变数据插值方法
Spatio-Temporal Attention-based Kriging for Land Deformation Data Interpolation
计算机科学, 2022, 49(8): 33-39. https://doi.org/10.11896/jsjkx.210600161
[8] 孙奇, 吉根林, 张杰.
基于非局部注意力生成对抗网络的视频异常事件检测方法
Non-local Attention Based Generative Adversarial Network for Video Abnormal Event Detection
计算机科学, 2022, 49(8): 172-177. https://doi.org/10.11896/jsjkx.210600061
[9] 胡艳羽, 赵龙, 董祥军.
一种用于癌症分类的两阶段深度特征选择提取算法
Two-stage Deep Feature Selection Extraction Algorithm for Cancer Classification
计算机科学, 2022, 49(7): 73-78. https://doi.org/10.11896/jsjkx.210500092
[10] 程成, 降爱莲.
基于多路径特征提取的实时语义分割方法
Real-time Semantic Segmentation Method Based on Multi-path Feature Extraction
计算机科学, 2022, 49(7): 120-126. https://doi.org/10.11896/jsjkx.210500157
[11] 侯钰涛, 阿布都克力木·阿布力孜, 哈里旦木·阿布都克里木.
中文预训练模型研究进展
Advances in Chinese Pre-training Models
计算机科学, 2022, 49(7): 148-163. https://doi.org/10.11896/jsjkx.211200018
[12] 周慧, 施皓晨, 屠要峰, 黄圣君.
基于主动采样的深度鲁棒神经网络学习
Robust Deep Neural Network Learning Based on Active Sampling
计算机科学, 2022, 49(7): 164-169. https://doi.org/10.11896/jsjkx.210600044
[13] 苏丹宁, 曹桂涛, 王燕楠, 王宏, 任赫.
小样本雷达辐射源识别的深度学习方法综述
Survey of Deep Learning for Radar Emitter Identification Based on Small Sample
计算机科学, 2022, 49(7): 226-235. https://doi.org/10.11896/jsjkx.210600138
[14] 张翀宇, 陈彦明, 李炜.
边缘计算中面向数据流的实时任务调度算法
Task Offloading Online Algorithm for Data Stream Edge Computing
计算机科学, 2022, 49(7): 263-270. https://doi.org/10.11896/jsjkx.210300195
[15] 刘伟业, 鲁慧民, 李玉鹏, 马宁.
指静脉识别技术研究综述
Survey on Finger Vein Recognition Research
计算机科学, 2022, 49(6A): 1-11. https://doi.org/10.11896/jsjkx.210400056
Viewed
Full text


Abstract

Cited

  Shared   
  Discussed   
No Suggested Reading articles found!